The Hammers slipped to 16th in the Barclays Premier League following their 3-1 defeat at Norwich on Saturday evening with Allardyce's side having won just twice so far this season.
But the 59-year-old said it was points, and not position, which means more at the stage of the campaign with West Ham currently having chalked up 10 points.
"I'm not nervous about the league position," he said. "I'm concerned that history tells you it is not the position that matters, it is the points total you have against games you've played and at present our points total is less than the games played and that is very dangerous."
West Ham have only managed to take two points after their memorable 3-0 win at London rivals Tottenham on October 6 and Allardyce knows they need to start picking up points following the international break.
"We can't keep saying we're playing well but not getting results," he added. "Everyone at this club is being paid to win and we're not winning the games we should be winning. We've got to get back to winning ways as quickly as we can."