Both men made their fortunes in sportswear retailing with Whelan taking over Wigan in 1995 when they were a lower league club and Ashley taking over Newcastle in 2007.
"When I first went there just after Mike Ashley had bought it he turned up in the boardroom in a pair of jeans, a pair of trainers and a replica shirt. Immediately he did that, the club's gone," Whelan told Thursday's Sun newspaper.
"You don't do things like that in football. He's got no class whatsoever. He's representing Newcastle United who were such a proud club.
"I immediately knew the supporters may want to have a pint with him on the terraces but basically he was not Newcastle through and through. The Newcastle fans know that.
"You can't get a Tottenham fan buying Newcastle and letting people thinks he supports them.
"It's not right, there's no pride left in the club."
Ashley was initially welcomed at Newcastle, especially after bringing back Kevin Keegan as manager, but after Keegan's departure earlier this season his popularity has plummeted with the team's league position.
Now third-last in the standings Newcastle are in real danger of relegation.
"I think he's got what he deserved. You don't go into a football club as big and proud as that and lower the standards," Whelan said.
Whelan sold his JJB Sports business in 2007 but has since bought back the group's fitness clubs. He has renamed them DW Sports Fitness and as a result will change the name of the club's 10-year-old JJB Stadium to the DW Stadium as of next season.
WIGAN FANS! Check FourFourTwo.com’s ever-expandinginterviews archivefor more stuff to read:
My Secret Vice Jimmy Bullard
Plus! Rate Wigan players (and others) on Talentspotter
NEWCASTLE FANS! Check FourFourTwo.com’s ever-expandinginterviews archivefor more stuff to read:
Web Exclusives Les Ferdinand
Q&A Joey Barton
One on One Michael Owen, Kevin Keegan, Les Ferdinand, Faustino Asprilla
Boy's A Bit Special Steven Taylor, Danny Guthrie
Ask A Silly Question John Barnes
Perfect XI Ruud Gullit
What Happened Next? Tony Cunningham
My Secret Vice Nolberto So
‘I don’t think Liverpool would look at Ollie Watkins, a striker isn’t a pressing issue for them – it’s Arsenal who need one’ Former Reds star explains why his old club don’t need an out-and-out forward this summer
‘He’ll still be playing at 40 at a good level because he’s in such good shape and looks after himself so well. He does everything to be a top professional’: Ex-Liverpool coach insists Mohamed Salah has plenty more miles in the tank
