The Gulls were already 2-0 down when Rene Howe struck in the 88th minute before then piling on the pressure in search of an equalising goal.
Taylor said: "In the first half we were disappointed to go in a goal down. I thought we did okay in the first half but not so in the second half when we didn't show enough to get a result.
"We got a late goal but it wasn't enough. Three points out of six against Cheltenham and Exeter isn't bad but after getting the three points in the first game you want something from this game.
"They had some decent opportunities to score more goals but we stuck at it and got the goal which was too late to rectify things.
"The game has gone now and we need to concentrate on the next one."
