The France international kept his composure to turn away from Ron Vlaar and fire past Brad Guzan in the 92nd minute as Newcastle recorded a first win in five games.
Pardew had seen his side go four home games in the Premier League without a goal, before Remy struck, and the former West Ham boss admitted the barren spell had played on his squad's minds.
He said: "The best player on the pitch got the goal.
"It was beginning to hang around us that lack of a goal. Our commitment and work-rate are what probably saw us over the line.
"It was an important goal as, although we have 40 points, in the scheme of the last few games it was important."
The build-up to the match had seen Pardew's job security questioned in some quarters, though the win put Newcastle back up to eighth in the league table.
Pardew is now determined to end the campaign on a high note, ahead of a close-season in which he hopes to be much more active in the transfer market.
He added: "We can build on this win now and the way we need to build is by finishing strongly and then we can go into the summer (and strengthen).
"We all know as much as we haven't spent any money in the last 18 months, we have got a nice little kitty there and we've got to make good use of it.
"If we make good use of it we can come back stronger next year."
‘I don’t think Liverpool would look at Ollie Watkins, a striker isn’t a pressing issue for them – it’s Arsenal who need one’ Former Reds star explains why his old club don’t need an out-and-out forward this summer
‘He’ll still be playing at 40 at a good level because he’s in such good shape and looks after himself so well. He does everything to be a top professional’: Ex-Liverpool coach insists Mohamed Salah has plenty more miles in the tank
