The visitors had taken the lead after 14 minutes through Hatem Ben Arfa, but Robin van Persie equalised almost immediately for the north London outfit.
With the game seemingly heading towards a draw, Thomas Vermaelen scored in the fifth minute of injury time to seal the three points for Arsenal, and make them the first team in Premier League history to come back from a goal down to win in four consecutive fixtures.
Arsene Wenger was delighted with the continued progression of his side, and pleased to get three points.
“It was a game of absolute commitment on both sides, you have to give credit to Newcastle as well,” he told Sky Sports.
“It needed something special to beat them tonight. And what beat them tonight was our relentless effort just to win the game. We just did not stop and in the end we won it.
“I said to my assistant in the final minute, ‘One more attack and we will score’, so much was my belief,” he admitted.
Arsenal have the weekend off due to elimination from the FA Cup, but face Everton at Goodison Park next Wednesday.
By Gareth McKnight