City's woes looked set to continue until they plundered an equaliser in the 86th minute. Fryatt gathered a Barry Hayles knock-on before firing a low shot from a tight angle across Steve Phillips and into the far corner of the net.
Then deep into stoppage time, Fryatt struck a dramatic winner after Rovers had failed to clear a Nicky Adams' corner. From the resultant scramble, the in-form striker took full advantage to ram the ball home from close range.
Rovers' fine form had looked set to continue when on the hour mark Ryan Green played a throw-in towards the edge of the area with the ball bouncing once before Joe Kuffour swivelled and struck a fierce shot into Paul Henderson's top-left corner.