The Eagles boss has been dealing with speculation about his future for some weeks and pressure has only grown after their heavy derby loss.
He held a prolonged meeting with Palace owner Steve Parish in the aftermath of the result, but was bullish when questioned about the outcome.
"I'm not talking about my future at the football club, I'm talking about the football club and that is all I have ever done," he said.
"I'm not going to talk about what we just spoke about to be perfectly honest.
"I will be speaking to him [Parish] Tuesday morning when the lads are in.
"It is about what is right for the football club and that is what it will always be about between me and Steve.
"We were having a meeting anyway, we always do when we are having a warm down. We will talk about some bits and pieces and learn from it. That is the meeting and that is what we always do."
Two first-half wonder strikes from Pajtim Kasami and Steve Sidwell followed up by second-half goals from Dimitar Berbatov and Philippe Senderos condemned Palace to a fifth consecutive defeat and left Holloway reflecting on the ruthless nature of the Premier League.
"We went with the same team that finished quite strongly against Liverpool and we got ourselves in front," Holloway told Sky Sports.
"But the ruthlessness of this division and the skill of some of these players you saw in that first goal which was completely something else.
"It knocked us a bit and I tried to pick them all up at half-time, then we go and make a couple of mistakes from set-pieces, which we're normally good at.
"It's tough and unforgiving, but we've got to bounce back. There was lots of good stuff in it, but unfortunately we're letting too many in and not scoring enough."
Palace's only win this season came against bottom club Sunderland and Holloway's side next face leaders Arsenal at home on Saturday.
The Palace boss added: "I think you end up with the stuffing knocked out of you, but you've got to deal with it, we're not the only team to be like that.
"A win will turn it right around and realise how close that we've been. To get ourselves in front, then we needed to be even more positive, but we're putting crosses in and not getting enough bodies in the box.
"I can't fault the effort, though, that was terrific. That quality comes out in the end and we've got to believe we've got it.
"We've got to work at it and pick ourselves up. Now it's Arsenal."