John Sutton struck in injury-time to rescue a 2-2 draw for the hosts, but McGlynn felt his side should have put the game to bed earlier.
The manager said: "We've got to be grateful for the fact we didn't give up and managed to salvage a point.
"It's still two points dropped from where I am. We were totally dominant in the first half and we should've been more goals in front from the amount of opportunities we had.
"Unfortunately it's the same old story. We're not killing teams off when we're on top.
"But to be fair when you're 2-1 down with not long ago, what you do want to do is go right to the end. We did that and I'm glad big Sutty got the goal."
Sutton, meanwhile, is considering buying up shares issued in an attempt to get Hearts out of their financial hole.
He said: "I'm going to look into it, a lot of the players are. Everyone in the changing room cares about the club. We all want to help the club in any way we can."