The Canaries were just five minutes away from recording a famous win over the high-flying Gunners courtesy of a close-range header from Michael Turner before a controversial penalty handed the hosts a lifeline, which they seized with two further goals to turn the match on its head.
The defeat leaves Chris Hughton's men still looking anxiously over their shoulders, only four points above the drop-zone and in need of probably another two wins to make sure of another crack at the top-flight again next season.
However, with key games coming up against Reading and then at Stoke before the visit of Aston Villa and former manager Paul Lambert, there is still enough time to put things beyond doubt.
Norway international Tettey said: "What can you say? We are really shocked with the decisions from the referees, but we just have to take it and move on.
"We were passing the ball and we had great control. They didn't create anything before Podolski hit the bar. Otherwise we had the energy to hold on to the 1-0.
"We just have to take the disappointment with us and turn it into something positive, at home against Reading.
"There is no getting one point or losing in that game. We need three points - that is a massive game for us."