Steve Clarke's side have not lost any of their last five matches against Villa and Mulumbu knows how important it is to the fans that they make it six after the international break.
The midfielder – who played in four of those five matches – scored the winning goal in their match at The Hawthorns in April 2011 and is hotly anticipating another home clash.
"I'm looking forward to this game," he told TheBirmingham Mail. "I've played in derbies against Wolves and Villa and the atmosphere is unbelievable.
"These games are really important to our fans.
"It's a really interesting game and a huge deal – like a Champions League game.
"I remember when I scored against Aston Villa – the fans were singing my name even outside the stadium. I'd love to do that again."
West Brom and Villa sit 10th and 11th respectively in the Premier League table after similar starts to the season, with both sides on 14 points from their opening 11 matches.
‘Slot hasn’t come in and changed everything, making it all about himself – it’s been about the players he’s inherited, getting the best out of a system he likes’: Liverpool manager impressing former players with personality and tactical approach
‘We thought we’d signed him, but Chelsea blew us away. I think they signed him so we couldn’t have him, as much as because they really wanted him’: Liverpool actually failed to sign Mohamed Salah in 2014, three years before finally getting the Egyptian
