Taylor, who managed the side before the arrival of new interim boss Alan Knill, admitted they are in a relegation dogfight after they came off second best against the fellow strugglers.
"People are angry, people are disappointed, people are asking questions of everybody and if you've been in the changing room you'd realise it's not a good place," he said.
"But there's another 14 or 15 games to go and we've got to get some points.
"I know I've said it before but we've got to go again, this game's gone now. We're disappointed because I think we warranted at least a point but we didn't get it. Well done Aldershot.
"Both teams are where they are and just need a bit of fortune. Both teams had opportunities and they took their chance and they've gone home with a 1-0 win.
"It's been a difficult day, we felt before the game there were going to be good opportunities to get a result. I am upbeat and I know the players will come again when we come into training again. We've got to come again, if not we might as well pack it up and all go home."
