The Eagles created the better chances in the goalless draw between the sides at Selhurst Park on Saturday, but face a tough task when they head to the Potteries for next week's replay.
However, Palace went to Manchester United and won in last season's League Cup so Australian midfielder Jedinak sees no reason why the Championship high-flyers cannot pull off another surprise and secure a home tie with Manchester City in the next round.
"Every game's difficult and you have to give every team respect," said Jedinak.
"But that said you can't stray away from what you believe in and your football philosophy.
"It was no different on Saturday, we set out a game plan and executed it quite well, but just in the final third we didn't quite make the right decisions at the right times.
"But I don't see why we can't go through. We've got a bit of confidence about the place and we are playing with that confidence at the minute.
"We know it will be a very difficult game, they've got a great record at home in the Premier League so we are not going to kid ourselves, but we'll take a lot of confidence from the first game."