The decision to replace Brian McDermott with Nigel Adkins failed to yield an immediate upturn in results as the Royals were hammered 4-1 at Arsenal in the new manager's first game.
That result left Reading bottom of the table on goal difference - seven points from safety and as short as 1/25 to return to the Championship come May.
But Robson-Kanu told the club's official website: "The season doesn't end at 31 games, it ends at 38.
"We need to make the most of every single one, and that starts on Saturday."
Southampton are the visitors to the Madejski Stadium at the weekend, and that represents a chance for Adkins to make a point to the club which sacked him in the autumn.
Robson-Kanu has been impressed by his new boss, and he said: "Training has been really positive.
"It was good to see the gaffer implement his own way of doing things and the boys have taken really well to him."
The Wales winger has also called on supporters to stick with the team beyond now and the end of the season, saying: "The fans really do make a difference to the whole team when they get behind us like we know they can."