Arsenal’s 10-match unbeaten run in all competitions come to a painful end in last weekend’s 4-0 thrashing at Liverpool.
But second-half goals from Bukayo Saka and Gabriel Martinelli at the Emirates Stadium made it four wins from their past five league games with a 2-0 success over Newcastle.
Written off after their poor start to the season, Mikel Arteta’s side are fifth, level on points with fourth-placed West Ham, as they chase a berth in next season's Champions League.
Howe was in charge of Newcastle in person for the first time after missing last weekend’s 3-3 draw against Brentford following a positive coronavirus test.
While the Saudi-led consortium that recently bought Newcastle have spoken about emulating the success of Manchester City under Middle Eastern ownership, Howe's only focus is saving the Magpies from relegation.
Read More: Arsenal’s worst season start in over 100 years
The former Bournemouth boss will need to drag much-improved performances from his winless team if they are to avoid a catastrophic slide into the Championship.
Already languishing six points from safety, bottom-of-the-table Newcastle face crucial games against fellow strugglers Norwich and Burnley over the coming week.
“Momentum in football is so important,” said Howe. “We need to get that win as quickly as we can.
“I’m a positive guy. I’ve seen enough from the two games to see we can compete. A neutral watching today wouldn’t think we were in the position we were in. It’s up to us to get the results we need.”
Gerrard earned his second successive win since taking charge of Villa as the former Rangers boss masterminded a victory at Crystal Palace, courtesy of goals from Matt Targett and John McGinn.
Dean Smith, the man Gerrard replaced at Villa, remains unbeaten as Norwich boss after the second-bottom Canaries drew 0-0 with Wolves at Carrow Road.
Brighton drew 0-0 with struggling Leeds in Saturday’s late match, with Seagulls manager Graham Potter ruing his team's lack of killer instinct.
