Despite taking the lead at White Hart Lane on Monday, Sunderland slumped to a 5-1 defeat against Tottenham to further dent their hopes of avoiding relegation.
Brown has admitted being at fault for Tottenham's first two goals and knows Sunderland, who are seven points adrift of safety at the foot of the table, are making life far too easy for opposing teams.
"Their player has got behind me for the first and second goals. We can talk all we want to about having to cut out the mistakes, but we have to," Brown told the Sunderland Echo.
"We have to do better when we're going forwards too. We're not helping ourselves.
"Unless we can produce 90 minutes where we're 100 per cent, we can only blame ourselves."
Brown insists Sunderland cannot give up hope of pulling off a great escape ahead of their final seven games this season.
"The table doesn't lie, it's bad," he added. "But we've got to keep going. That's all you can do.
"Of course it’s difficult. You can try not to look at how bad it is, but you do.
"We've got to show a bit of pride in ourselves and keep on grinding it out."
‘He instantly popped into our ratings as one of the best U21 midfielders in Europe. The impressive thing is Slot has made him into more of a no.6' Inside Ryan Gravenberch's transformation at Liverpool
‘I don’t think Liverpool would look at Ollie Watkins, a striker isn’t a pressing issue for them – it’s Arsenal who need one’ Former Reds star explains why his old club don’t need an out-and-out forward this summer
