Lethal Collin scored at the beginning and end of the game to take his tally for the season to 16 to spark delirious scenes of celebration at the final whistle.
Stevenage recovered from conceding a goal after only 108 seconds to have the better of the second half and a goal from Darius Charles gave them hope of avoiding a giant-killing only for Collin to strike again three minutes from time.
Isthmian League Maidstone went ahead in the most basic of manners, a long clearance from goalkeeper Lee Worgan was headed on by Alex Flisher into the path of Jay May. Veteran Stevenage goalkeeper Chris Day could only parry May’s soft shot but the rebound fell for Collin to lash home from 10 yards.
Worgan made excellent saves from Lee Barnard and Roarie Deacon in the first half as Stevenage fought desperately to get back into the match.
But they had to wait until the 47th minute before Charles volleyed in a centre from Charlie Lee and for long spells it looked as if Graham Westley’s side, 60 places above seventh tier Maidstone in the league pyramid, would take control.
But with extra time looming, substitute Ben Greenhalgh got clear on the left and his perfect centre was headed in by Collin, with Stevenage appealing for offside.
Maidstone now face Wrexham in the second round next month.