The Potters moved six points clear of the drop zone with a 2-0 win at QPR last weekend and can edge further to safety if they beat another relegation rival in Norwich on Saturday.
"It's important the fans don't get impatient," Kemp told The Sentinel.
"It would be great to be 5-0 up at half-time, but if not, don't panic because we are quite capable of winning the game late on.
"We got what we required on Saturday. The players showed fight and were prepared to stand up and be counted in a pressure game.
"Now we want another performance and another win this Saturday."
Stoke are just three shy of manager Tony Pulis's 40-point survival target but with four games to go, Kemp hopes for a higher yield.
"I don't like setting targets personally because if you get there you can take your foot off the gas," he added.
"And if you take care of your own business, you don't have to worry about anybody else."