Since winning promotion to the Football League in 2009, all seven of Albion's ties have been away.
On Tuesday night, the Pirelli Stadium will host its first fixture in the competition when Premier League club Fulham are the visitors for a second-round clash.
Rowett said: "I suppose it's unusual to have so many away ties on the trot but finally, after four years of waiting, we have been drawn at home.
"And it's a fantastic draw. You are ideally looking for a Premier League team, and I think it will be the first time we have played a top-flight team too in the competition, and we have got one and it's a chance to test ourselves against the best.
"It will be an occasion. It will be nice for our fans to see us play a Premier League team at our own stadium.
"We have been strong at home recently and we aim to continue to be so this season.
"Being at home will certainly help us. If you look at some of the teams, you know they are going to play a weakened side so that might help us too.
"But Fulham will see us as an opportunity to progress. I'm sure they will play two or three of their kids - but they will be good kids capable of playing in the Premier League."
Burton's first three ties in the competition saw them suffer heavy first-round defeats at Reading, Cardiff and Burnley before last season getting their first win in the competition against Sheffield United.
Another away win at Leicester followed before Bradford beat Rowett's side on their way to an historic final appearance.
Albion repeated their win at Bramall Lane this season in the first round and Rowett feels his team have now found their feet in the competition.
"Before the draw I joked about us getting Leicester or Bradford again after getting Sheffield United in the first round again this year," said Rowett.
"So it's someone different, and that in itself is nice.
"I think we've acclimatised, if you like, to cup football. As a team coming up from the Conference it is going to take time and I guess they learned the hard way in those early years.
"But in the last year or so we've shown we can more than compete against teams from the leagues above us and hopefully we can carry that on against Fulham on Tuesday night in front of our own fans."