The former Croatia international has suffered with the problem throughout the season, restricting him to just 19 Premier League starts in 2014-15.
Jelavic has scored eight goals in that time, and has recently struck up a useful partnership with January signing Dame N'Doye.
However, Thursday's announcement means Jelavic is unlikely to return before May, although he could make his comeback for Hull's run-in as they look to avoid the drop down to the Championship.
"The club's medical staff had hoped to manage Jelavic's knee through until the end of the season, however, following the Leicester game [last Saturday] it was decided surgery should take place as soon as possible to prevent further damage and complications in the future," a Hull statement read.
"Jelavic will now undergo a period of rehabilitation in his bid to regain fitness."
‘He instantly popped into our ratings as one of the best U21 midfielders in Europe. The impressive thing is Slot has made him into more of a no.6' Inside Ryan Gravenberch's transformation at Liverpool
‘I don’t think Liverpool would look at Ollie Watkins, a striker isn’t a pressing issue for them – it’s Arsenal who need one’ Former Reds star explains why his old club don’t need an out-and-out forward this summer
