The Young Boys Berne defender was forced to come off just nine minutes into his country's 5-2 Group E thrashing at Arena Fonte Nova after being accidentally kicked in the face by France striker Olivier Giroud.
Von Bergen, who suffered a nasty cut just under his left eye, was taken to hospital in Salvador and it was confirmed by the Swiss Football Federation on Saturday that his tournament is over due to a fractured eye socket.
The 31-year-old will fly home from Brazil and must watch from afar as Switzerland attempt to put their hammering at the hands of France behind them and qualify for the last 16.
Ottmar Hitzfeld's side face Honduras in their final group game next Wednesday, with second-placed Ecuador - level on points with Switzerland, but with a superior goal difference - up against group leaders France.
‘I don’t think Liverpool would look at Ollie Watkins, a striker isn’t a pressing issue for them – it’s Arsenal who need one’ Former Reds star explains why his old club don’t need an out-and-out forward this summer
‘He’ll still be playing at 40 at a good level because he’s in such good shape and looks after himself so well. He does everything to be a top professional’: Ex-Liverpool coach insists Mohamed Salah has plenty more miles in the tank
