Having drawn with Montpellier and Ajaccio, Laurent Blanc's PSG side could ill-afford to fall further behind leaders Marseille, who host fellow title contenders Monaco on Sunday evening.
They left it late but finally prevailed thanks to strikes from Adrien Rabiot and Zlatan Ibrahimovic against their recently promoted visitors.
Evian climbed off the bottom after posting their first ever league victory over Les Gones.
Despite Jordan Ferri's second-half strike, a first-half Kevin Berigaud brace was enough to inflict a second consecutive surprise defeat on Remi Garde's men following their 1-0 loss at home to Reims last week.
Toulouse slipped to the foot of the standings after going down 2-1 at home to 10-man Bastia.
The Corsican side took the lead through Claudiu Keseru two minutes before half-time, despite having lost defender Julian Palmieri to a straight red card for a challenge on Oscar Trejo six minutes earlier.
TFC hit back in the 57th minute through Martin Braithwaite but were unable to further capitalise on their one-man advantage, with Bastia instead going on to score the winner through Romaric 10 minutes later.
The result left Toulouse still in search of their first league win, and rock bottom of the table on goal difference after Sochaux picked up their second point of the campaign with a 0-0 draw against Ajaccio at Stade Auguste Bonal.
The matches between Reims and Nantes, and Rennes and Lille, also both finished goalless.
Finally, Vincent Aboubakar scored the only goal in the 14th minute as Lorient condemned Valenciennes to a third consecutive league defeat. VA's miserable evening was compounded five minutes from time when Rudy Mater was dismissed for a second bookable offence.