At least Mikel Arteta can always rely on Kai Havertz these days. The Arsenal striker scored for the seventh successive home game to match Robin van Persie’s record and inspire a dramatic comeback after his side found themselves behind against struggling Southampton.

Still without a win seven matches into the new campaign after being promoted last season, Russell Martin must have been dreaming of causing a major upset when the substitute Cameron Archer silenced the home crowd early in the second half. Havertz had other ideas and his equaliser three minutes later provided the impetus for Gabriel Martinelli to score a second before the outstanding Bukayo Saka wrapped up the points on a day that was almost one to remember for Aaron Ramsdale against his former club.

“He wants more and he is not satisfied with what he is doing. There is still another level from him,” Arteta said of Havertz’s performance. “Something has changed in him and that confidence – you really sense it. Now he is winning football matches.”

Southampton had arrived in north London in hope rather than expectation, having never managed to win here in 24 previous attempts in the Premier League. They departed having failed to improve on that dismal record, even if Martin could take heart from a battling performance after a testing start to life back in the top flight. “I think we’re learning and growing. We’re on a journey,” reflected the Southampton manager.

Given Arsenal’s hectic schedule since the last international break, it was no surprise to see Arteta rotate his squad and hand Raheem Sterling a first Premier League start since joining from Chelsea on loan. But it was not until he and Gabriel Jesus were withdrawn that Arsenal assumed control after Ramsdale had played his part in keeping his old employers at bay.

The England goalkeeper revealed this week that David Raya had been the first person to message him following his move to the south coast and insisted that he bears no grudges towards the man who replaced him as Arsenal’s No 1. But Ramsdale must have momentarily forgotten which side he was playing for in the early stages here when he passed the ball straight to Sterling, who was clumsily bundled over by Jan Bednarek inside the area. To Arteta’s frustration, the referee, Tony Harrington, waved away their appeals for a penalty.

Yet besides another corner that was headed over by Havertz, Ramsdale did not have much else to do in a strangely subdued first half. Having been heavily criticised for their performance in a 3-1 defeat to Bournemouth last Monday, Martin’s defence stood up to the sizeable challenge. The home crowd’s frustration was becoming audible when Jorginho flashed a volley just past Ramsdale’s post after good work down the right flank by Saka. Sterling almost found a way through when he was played in by Jesus before Arsenal finally forced Ramsdale into a save when he pushed Thomas Partey’s low drive round the post.

Southampton came within inches of breaking the deadlock at the start of the second half when the impressive 18-year-old Tyler Dibling left Riccardo Calafiori for dead, with Mateus Fernandes firing just over with a flying volley. The Portuguese midfielder was the architect of Archer’s opener minutes later, the striker showing great composure inside the area to beat Raya at his far post.

Their lead did not last long. It had been a quiet afternoon by Havertz’s recent standards until the German forward decided to take matters into his own hands when he curled the ball past Ramsdale off the post to equalise. Suddenly Southampton were hanging on for dear life. They were undone soon after by a brilliant cross from Saka that picked out an unmarked Martinelli at the far post to apply the finish.

Ramsdale did well to save from Saka as Arsenal attempted to kill the game off. But Raya was lucky to escape after turning Dibling’s curler round the post when he flapped at the ensuing corner and Taylor Harwood-Bellis somehow struck the crossbar from close range.

It was left to Saka to steady Arsenal’s nerves with a first-time finish past Ramsdale, who was roundly applauded by both sets of fans at the final whistle.