The winger failed to make the bench for Wednesday's 1-1 result after he was part of the side that were thumped 4-0 by Liverpool last weekend, with Alex Kacaniklic taking his place.
Richardson has struggled to make an impact at Craven Cottage since arriving from Sunderland for a reported £2million in the summer and Jol says he expects to see more from the 28-year-old.
The manager told The Sun: "He's lacking the spark and a little bit of fitness.
"Alex Kacaniklic is only 20 and Richardson should be better than him. But he hasn't been.
"I want him to do well and be better than what I've got. He knows and he wants to do better."