Ward-Prowse scored a dramatic 96th-minute penalty soon after Allan Saint-Maximin appeared to grab an injury-time winner for Newcastle.
The hosts had looked set to pick up their first win of the season at St James Park after Saint-Maximin struck in the 90th minute, firing in from a loose ball after Alex McCarthy had initially denied Ryan Fraser's effort.
But we were then awarded a spot-kick by VAR soon after when Adam Armstrong was fouled by Jamaal Lascelles inside the box, and Ward-Prowse stepped up to confidently slam home the penalty.
It was a deserved point for the, we had dominated much of the game. We even spurned several chances to take the lead in the first half before Callum Wilson headed Newcastle in front against the run of play after the restart.
Mohamed Elyounoussi, who scored a hat-trick in an 8-0 win against Newport County in the League Cup in midweek, bundled in an equaliser late on after his initial effort was kept out by Freddie Woodman.
But then came the drama of injury time as Newcastle fans celebrated wildly what looked to be a winner from Saint-Maximin before Ward-Prowse's penalty ended a run of seven straight defeats on the road in the Premier League for us.