Newcastle were already trailing 2-0 at the Etihad Stadium when Taylor was dismissed in first-half stoppage-time for swinging an arm at Sergio Aguero.
Pardew does not believe Taylor's actions were malicious and is adamant it was out of character for the centre-half.
"I have to say I thought we gave a good account of ourselves up until the sending off," Pardew told Sky Sports.
"We'd threatened their goal, but the sending off made it a really difficult night for us and you don't want that on the first day.
"It was a silly challenge from Tayls, it was out of character for him, and then we had to work and grind in the second half, which we did.
"I just thought it was a silly action, and I can't really defend him on it, if I'm honest. I know he's a proper fella and he wouldn't mean to be malicious to the guy."
The Magpies face Pardew's former club West Ham in their next game on Saturday and he does not feel there is too much to be worried about, despite the heavy nature of the City defeat.
He added: "I don't think we've got too much to be concerned about.
"We need to put a team out that's a lot more offensive at home, and we won't have that kind of opposition, although West Ham are in good shape.
"It's one out of 38 games, and it's important we try and win the two home games that are coming up."