Palace moved off the bottom of the Premier League table after Tuesday night's win over West Ham, but Pulis admits there is still plenty of work to do if he is going to steer the south Londoners to safety.
Blackburn defender Scott Dann and Peter Crouch, who played under Pulis at Stoke, have been linked with the Eagles.
"There are areas in the group that you think we certainly need to improve," he said.
"But it is getting the right players and it is getting the right deals done. That is the biggest thing and that is always a worry for a manager.
"The last thing I want to do is bring players in here who can't and won't start, who would just drag things down again.
"They have got to be players that will automatically get in your team given the opportunity and the chances. That they will raise the standards."
Pulis is expected to link up again with Dave Kemp, who was his assistant at Stoke, and also played for Palace and was No 2 to ex-Eagles boss Alan Smith.
Former Tottenham manager Gerry Francis has also worked with Pulis in the past and could be another addition to his backroom team.
When asked about the duo, Pulis said: "I am keen to bring certain people into the football club if I can.
"I have spoken to the chairman about it and [chief executive] Phil Alexander about it. If we can do it, then they've said they will try and do it for me.
"I just think you need people around you that have been used to working in the Premiership, have got that background and also understand how difficult this job is going to be."