Despite falling behind to an Andre Ayew penalty and having Thiago Motta sent off, a Maxwell header and a second-half Zlatan Ibrahimovic penalty proved to be enough to seal a vital three points which moved the capital club back level on points with Claudio Ranieri's men at the top of Ligue 1.
Defeat for Marseille, only their second of the season after a home defeat to Monaco, leaves them four points behind the joint leaders which, even so early in the season, looks like a difficult mountain to climb.
Montpellier put an end to a run of five consecutive draws in stunning fashion with a 5-1 win over 10-man Lyon at the Stade de la Mosson.
Braces from Victor Hugo Montano and Remy Cabella and an Anthony Mounier strike secured an emphatic win for the hosts, only their second league victory of the season.
Alexandre Lacazette's early second-half strike, which made it 2-1, was scant consolation for Lyon, who suffered their heaviest ever defeat in Montpellier.
The visitors had to play out the final minutes with 10 men after Maxime Gonalons was shown his second yellow card.
Bordeaux came from behind to end a run of five Ligue 1 games without a win with a confident 4-1 victory over managerless Sochaux at the Stade Chaban-
Goals from Henri Saivet, Jussie and a Cheikh Diabate brace, all after Roy Contout had fired Sochaux into an early lead, were enough to secure an important three points for Francis Gillot as his team look to put an end to a disappointing start to their season at the expense of his former team.
Defeat for Sochaux leaves them second-bottom in the table and brought a swift halt to their mini-revival having beaten fellow strugglers Valenciennes last time out.