The Magpies appeared to be on course to end a run of three straight league defeats, but the Potters came back from 1-0 down with two late goals.
Pardew was disappointed with the result and felt that his side deserved to leave the Britannia Stadium with all three points:
“The improvement from Sunday was immense and we deserved to get something from today and we certainly didn’t deserve to get beat that’s for sure, we were the better side,” Pardew told SkySports.
“There is a crucial moment in the game at 1-0 where I thought we had a handball and I just looked again and I think it is a penalty and then two sucker punches really and we have got beat,” he said.
“Their keeper has made two good saves, and it is galling really as we are on this run and we are having setback after setback and I feel sorry for the players today as they were brilliant,
“Sometimes you don’t get what you deserve and we certainly didn’t today.
“We made a couple of errors in those goals and that has cost us. We do not make many errors but we have tonight.”
Papiss Cisse gave Newcastle the lead just after half-time, but goals from Jon Walters and Cameron Jerome in the final ten minutes swung the tie.