A 1-0 win at the weekend lifted the Baggies five points clear of the relegation zone with six games remaining, and Olsson now feels they can look forward to Saturday's clash against Tottenham Hotspur with renewed confidence.
He was particularly pleased with the clean sheet at Carrow Road and hopes they can keep the momentum going in the final few weeks of the season.
"Saturday's win takes some pressure off us but we're still very much in it," Olsson said in the Birmingham Mail.
"We're very happy and I thought we did what we spoke about before the game. We followed our game-plan very well.
"It wasn't pretty maybe but we got the first goal, which was important, and then we defended well and got the three points. Saturday's results dragged a few more teams into the relegation battle.
"We're on the up, we have seven points from the last four games, so we're in good shape and we're looking forward to the last six games."