Twice Moore's men led, but twice Portsmouth pegged them back as goals from Gabor Gyepes and Jake Jervis cancelled out efforts from Ash Taylor and Michael O'Halloran respectively.
And despite staying top of the pile on goal difference, Moore was not impressed as his side made it four league games without a win.
"I'm definitely frustrated, only one team was going to win it I thought," he said.
"To get caught defensively like that, its poor defending and we know it. I can't fault the effort that they've given, but they were really poor defensively.
"We're throwing points away. We have two tough away games to come. It just feels like a defeat really.
"Defensively I'm not going to single the person out, he knows what he's done wrong. One man slept and he's cost everyone. It's criminal.
"You need the second goal, but we gave them a lifeline just after half time. We've huffed and puffed but once you get to 2-1, you've got to see the five minute period out. But we gifted them the equaliser. We didn't even get chance to enjoy our goal.
"They get paid to score goals and the others get paid to defend. We don't look like keeping a clean sheet, that's the worry for me."
