City's 2-0 win at Crystal Palace and Liverpool's 2-0 loss at home to Chelsea put the league title in the hands of Manuel Pellegrini's team.
Kompany said it was a long way from being over – City are third and three points adrift of leaders Liverpool, but have a game in hand and a better goal difference.
"It is difficult to predict the outcome of this league," the Belgium international said.
"You would be crazy to think it is over, but obviously we did our job. It's in our own hands and you can't do more than that.
"There have been so many swaps and changes over the season, we are still very calm.
"By definition, I think we are the team in the league that can't ever give up - especially after the year we won it.
"We just kept our heads down. We knew we didn’t play to well and had to change it - the last two games have been good.
"Ultimately it's about the last straight and we seem to pick it up at the right time."
City finish their league campaign with clashes against Everton, Aston Villa and West Ham.
‘He instantly popped into our ratings as one of the best U21 midfielders in Europe. The impressive thing is Slot has made him into more of a no.6' Inside Ryan Gravenberch's transformation at Liverpool
‘I don’t think Liverpool would look at Ollie Watkins, a striker isn’t a pressing issue for them – it’s Arsenal who need one’ Former Reds star explains why his old club don’t need an out-and-out forward this summer
