The Terriers twice led against Posh but Darren Ferguson's men pegged them back both times, with Dwight Gayle's 86th-minute goal ensuring both sides ended with a point.
The big plus for Huddersfield is that the result moves them out of the relegation zone and a point above Blackburn.
"It's a point gained and the positive is that we move up the table," said Robins. "We are devastated not to win the game but we fell into the bottom three and we've only been there a week.
"There are going to be many more twists and turns before the end of the season."
Robins added: "In all fairness a draw was probably the right result.
"This was a tough, tough game and Peterborough have been in good form.
"I am not going to be too critical of them at this stage but we have to start seeing games out.
"What happens this season is still in our hands. We have Wolves and Blackburn up next and it's what we do that matters. We don't have to rely on other results."