The Eagles' automatic promotion hopes look over after a run of five games without a win, four in which they have failed to score, including Saturday's goalless draw with Barnsley.
But they remain destined for a play-off spot, which Ramage feels is some achievement after a tough start to the season at Selhurst Park.
"Everyone's doom and gloom at the moment but we are fourth in the league, six points from seventh," he said.
"People have got to realise we lost our first four games of the season. We were adrift at the bottom and we've turned it around.
"So it's not all doom and gloom. Okay, we haven't won in the last few games but against Barnsley we didn't play badly. We just didn't get that rub of the green in front of goal."