Adam Lallana scored the winner five minutes into stoppage time as Liverpool beat Norwich 5-4 in a remarkable game.
The Reds took the lead on 18 minutes through Roberto Firmino after good work from Jordon Ibe, Alberto Moreno and Milner, with the Brazilian poking the ball beyond Declan Rudd.
Norwich replied within 10 minutes through Diumerci Mbokan’s clever back heel, and the hosts went into half-time with an unlikely 2-1 lead after Steven Naismith scored an excellent goal on his debut after signing earlier this month.
Alex Neil’s side then added a third just ten minutes into the second-half, with Wes Hoolahan converting from the penalty spot to make it 3-1 after Alberto Moreno fouled Naismith.
Captain Jordan Henderson pulled one back for Liverpool within a minute, and Firmino drew the visitors level with an excellent team goal from Adam Lallana’s assist on 63 minutes. At this stage there had been six shots, all of which had resulted in a goal.
Liverpool secured an unlikely comeback with 15 minutes remaining, with Norwich captain Russell Martin’s short back pass allowing Milner to run through on goal, and the England international made no mistake with his finish.
Norwich then scored an improbable equaliser two minutes into stoppage time, with Sebastien Bassong lashing home a 20-yard drive past Simon Mignolet to level the scores.
But Liverpool had the last say, with Adam Lallana crowning a remarkable game by scoring five minutes into stoppage time, helping Liverpool to a 5-4 win.
The Canaries looked lively early on, with Naismith, Nathan Redmond and Hoolahan floating around in spaces between Liverpool’s defence and midfield. But it was Liverpool who struck first.
Moreno and Milner combined well on the left and the latter fed Firmino.
The Brazilian was played onside by Robbie Brady and his scuffed shot went in via the boot of Declan Rudd and the post.
Brady recovered well to deny Milner inside the area moments later before Norwich exposed Liverpool’s aerial vulnerability to draw level when the visitors twice failed to clear a corner.
Graham Dorrans headed back in and Mbokani did the rest, controlling the ball with his back to goal before his improvised finish left Sakho sprawling on the floor.
Liverpool’s defence was again found wanting when Hoolahan beat Henderson and found Naismith, who finished brilliantly across goal for an interval lead.
Naismith next stole in on the wrong side of Moreno before the left-back lunged in from behind.
It might have been a foul, but Moreno made certain by recklessly bundling Naismith over from behind. Hoolahan converted the penalty.
Liverpool pulled one back within moments as Firmino flicked Nathaniel Clyne’s cross on to an unmarked Henderson, who swept in.
The Reds equalised when Milner found Lallana, who centred for Firmino to control the ball once and prod it past Rudd.
It went from bad to worse for Norwich as Martin inexplicably passed back in the direction of Rudd without looking.
Milner intercepted and finished calmly to restore Liverpool’s advantage only for Bassong to finish superbly from 22 yards for what he thought was the equaliser.
There was another twist to come, though, as Norwich failed to clear and Lallana’s shot looped over Rudd.