The Norwich striker emerged as a dark horse for a call-up to the national team ahead of Euro 2012 after netting 15 league goals in the Canaries' first season back in the top flight, but was ultimately overlooked by England boss Roy Hodgson.
Holt claims the snub was down to Norwich not being viewed as "fashionable", and believes Southampton's Rickie Lambert is the victim of similar prejudice this season.
The 31-year-old Holt concedes his form this season is not worthy of and England call-up - he has just five goals in all competitions - but nevertheless frustration remains.
"It bugs me," Holt told the Daily Telegraph. "I should have been there in the summer; if not the Euros, I should definitely have had the chance in the two friendlies before.
"It bugs me when a squad is called and I don't hear Rickie Lambert's name mentioned once, not one breath, and he's on form, scoring, similar to what I did last year.
"Is it the 'fashionable club' thing? Are we so stuck in our ways that you have to be at Manchester United, Arsenal or Tottenham?
"If I'd been at Arsenal as a kid, and done what I'd done last year for Arsenal, would I have got in the squad? Yes. So what difference does it make if I'm doing it for a so-called 'lesser team' Norwich, banging 18 goals in?
"Why am I not getting a sniff? There was no contact.
"This year, there's no way in the world I'm going to get called up. My goal tally is not good enough, but that was disappointing last year. I was scoring against the top teams, United, Arsenal, Chelsea, and I don't get the nod. It just disheartens me.
"When I then watched the Euros and saw England go out with a whimper, it made it tougher to take. If they'd gone to the semi-finals, it would have been easier to say I should never have been near it.
"I watched that and thought, would I have made that difference?"