A key figure for the Hammers at the start of the season, Reid is back in contention after undergoing ankle surgery.
He has made two appearances off the bench since returning to fitness, but remained stuck on the sidelines in midweek as West Ham claimed a crucial 2-0 victory over Norwich City.
Allardyce's men have now taken maximum points from their last three outings to pull four points clear of the relegation zone.
Having found a system that works, sticking with it is now the intention at Upton Park.
That means commanding centre-half Reid, who is currently away on warm-weather training with the rest of the Hammers squad, will have to be patient as he attempts to force his way back into the starting XI.
Allardyce said in The Sun: "I've got so many lovely problems. Winston Reid is chomping at the bit on the bench but there's nothing you can do when the team is winning.
"Take Joe Cole, an excellent player who did not even make the squad for the Norwich game.
"It's great for me, disappointing for them, but you can't really argue with a team that's winning can you? And my two centre-halves are playing ever so well."