Bundesliga leaders Leverkusen said the operation was to repair cartilage damage for Rolfes, who has only just returned following a three-month injury absence.
"This is a major shock for us," sporting director Rudi Voeller told reporters. "It is especially painful for Simon and we must now give him confidence and support him as much as we can. He must think positively."
Leverkusen said he would be out for several weeks. Rolfes also had two previous operations on the same knee last year.
The 28-year-old, who has won 21 caps since 2007, is looking to take part in his first World Cup in South Africa in June.
Rolfes felt pain in his knee during a brief appearance in Leverkusen's 3-0 win at Hoffenheim on Sunday.
Germany manager Oliver Bierhoff said he was not out of contention for a spot in the World Cup squad.
"One should not hurry to rule him out," Bierhoff told reporters. "We should keep our fingers crossed he comes back and plays soon."
Germany coach Joachim Loew said they would wait and see how long a recovery he would need but ruled out a return to the squad for Torsten Frings.
Loew informed the experienced Werder Bremen midfielder last week he would not feature in his World Cup squad.
"That is out of the question. This was a fundamental decision," Loew told the SID news agency.
"(Rolfes' injury) is a setback for us but we must first wait and see how long he will be out."
‘I don’t think Liverpool would look at Ollie Watkins, a striker isn’t a pressing issue for them – it’s Arsenal who need one’ Former Reds star explains why his old club don’t need an out-and-out forward this summer
‘He’ll still be playing at 40 at a good level because he’s in such good shape and looks after himself so well. He does everything to be a top professional’: Ex-Liverpool coach insists Mohamed Salah has plenty more miles in the tank
