Asmir Begovic scored a freak goal in Stoke City's draw with Southampton, while Sunderland had two men sent off in defeat at Hull City.
Managerless Crystal Palace lost again, this time at West Bromwich Albion, as West Ham United's wait for a home win continues after drawing with Aston Villa.
Manchester City dropped Joe Hart for the visit of Norwich City, but his replacement Costel Pantilimon had nothing to do in a 7-0 romp at the Etihad Stadium.
City went ahead in the 16th minute when David Silva's blocked shot fell to Sergio Aguero and his attempt struck a Norwich defender before ricocheting beyond John Ruddy off Bradley Johnson.
Aguero and Silva were involved in the second goal four minutes later when the Argentine striker teed up the Spanish midfielder to drill a low shot past Ruddy.
The third goal arrived on 25 minutes when Matija Nastasic met Samir Nasri's corner and his header deflected off Russell Martin and inside the post.
The home side made it 4-0 in the 36th minute through Alvaro Negredo's close-range finish, although Aguero looked offside when he was chipped through by Yaya Toure before crossing for his team-mate.
Manuel Pellegrini's men got their fifth goal through a fifth different scorer on the hour mark when Toure curled a 25-yard free-kick over the wall and beyond Ruddy's reach.
City added a sixth goal on 71 minutes when Silva's cross was dealt with poorly by Sebastien Bassong as his clearance dropped straight to Aguero to lash a first-time shot past Ruddy.
Substitutes Jesus Navas and Edin Dzeko linked up for a seventh goal four minutes from time when the summer signing played the ball into the feet of the Bosnian, who span and curled a low shot inside the post.
Arsenal opened up a five-point gap at the top of the Premier League thanks to an impressive 2-0 win over Liverpool at Emirates Stadium.
Santi Cazorla broke the deadlock for the Gunners with a fine volley in the 19th minute after his initial header had hit the post.
Aaron Ramsey then continued his superb form with a stunning strike from outside the area just before the hour mark and Liverpool could not find a response.
Manchester United's blistering first-half display was enough to compensate for a sloppy second-half showing in a 3-1 win over Fulham at Craven Cottage.
United took the lead on nine minutes when Robin van Persie slipped in Wayne Rooney, who took his time before picking out Antonio Valencia to side-foot home.
Fulham's offside trap malfunctioned again on 20 minutes when Adnan Januzaj played in Van Persie to thump a left-foot shot past Netherlands team-mate Maarten Stekelenburg.
Van Persie eluded Fulham's offside trap again two minutes later as he got down the right before rolling the ball across goal to present Rooney with a tap-in.
The Cottagers pulled a goal back on 65 minutes when substitute Alex Kacaniklic made an immediate impact as his shot from the edge of the area took a huge deflection off Rooney and left David de Gea with no chance.
Darren Bent headed against the crossbar and former United player Kieran Richardson glanced wide as the three enforced half-time substitutions made by David Moyes disrupted the flow of his team.
Newcastle United produced an impressive second-half performance to beat Chelsea 2-0 at St James' Park to record a first home Premier League win in two months.
Chelsea had made the brighter start to the game and struck the crossbar twice in the 13th minute through captain John Terry and fellow defender Branislav Ivanovic following a Juan Mata corner.
But Newcastle were much improved after half-time and took the lead on 68 minutes when Yohan Cabaye curled in a brilliant free-kick from deep and Yoan Gouffran headed beyond an exposed Petr Cech.
Newcastle wrapped up the points a minute from time when Vurnon Anita's low pass teed up Loic Remy to flash a left-footed shot in off the post.
Stoke goalkeeper Begovic scored the quickest goal of the season in bizarre circumstances in a 1-1 draw with Southampton at the Britannia Stadium.
The Potters were in front after just 13 seconds in freakish circumstances when Begovic booted the ball downfield and, aided by a strong wind, it bounced over opposite number Artur Boruc.
Southampton equalised three minutes before half-time when James Ward-Prowse's excellent deep cross picked out Jay Rodriguez, whose downward header bounced over Begovic and into the net.
Steve Bruce enjoyed victory over his former club as Hull City won 1-0 at the KC Stadium against a Sunderland side which played the second half with nine men.
Hull went ahead on 25 minutes when Liam Rosenior's cross from the right was headed past his own keeper by Sunderland defender Carlos Cuellar at the near post.
A lengthy stoppage ensued after Sunderland keeper Keiren Westwood was injured and he was eventually forced off before the visitors' day got worse following two red cards in added time.
Cattermole was shown his seventh red card in the Premier League following a lunging challenge on Ahmed Elmohamady before Andrea Dossena was dismissed after an awful tackle on another ex-Sunderland player - David Meyler.
Crystal Palace slipped to a ninth defeat in 10 games after goals from Saido Berahino and Gareth McAuley earned West Brom a 2-0 win at The Hawthorns.
West Brom made the breakthrough on the stroke of half-time when Stephane Sessegnon got down the left and rolled the ball across the edge of the area for substitute Berahino to finish past Julian Speroni.
The Baggies made sure of the points seven minutes from time when Chris Brunt drilled over a corner from the left and McAuley powered in to head home.
West Ham are still searching for a first home win since the opening day of the season after being held 0-0 by Aston Villa at Upton Park.