Second-half goals from Jeff Hughes and Jamille Matt set up a granstand finish as the home side battled back from three-nil down at the break.
And Rowett was delighted to see his team safely across the line - thanks to goals from Rene Howe, Adam McGurk and Chris Hussey - but insists there would be no getting carried away with the result.
"We've started the season well. That's it. I'm not going to look at a league table," he said, with Albion having taken seven points from the opening nine on offer.
"We know there's a long way to go and we've got to keep performing as a team.
"We've got a really bright group of players and I'm pleased with them."
Yet the finale, at a rain-soaked Highbury, was not to Rowett's liking.
He said:"It wasn't a wonderful game of football, but never the less you've seen five goals.
"There were some real bits of entertainment.
"Maybe it's ended up being just a little too entertaining for my liking."