Owain Tudur Jones had given the hosts the lead with a powerful strike but in the 90th minute, the same player felled Callum Paterson and Marius Zaliukas fired home from the spot to earn Hearts a point.
He said: "It's frustrating more than anything else. I had a right go at the players because I felt we threw away two points.
"We had chances to win the game, although we were nowhere near our best and gave the ball away too much in the second half.
"The most disappointing aspect is that we didn't kill Hearts off. I didn't think it was a penalty, but the referee has given it and he's closer.
"Again it's disappointing because I felt we should have cleared the danger.
"All the talk up here this week was, if we beat Hearts four or five nil, we would go top in our own right.
"That is a new experience for us and I don't think we dealt with it very well but a 10-match unbeaten run is fantastic."