The Welsh outfit are currently 10 points above the relegation zone, and their goalkeeper is targeting their next two games for more vital points.
The Swans take on Fulham at Craven Cottage on Saturday, before hosting struggling Aston Villa on New Year's Day.
Billed as a surprise package last year in their first taste of life in the Premier League, Swansea have built upon the work of Michael Laudrup's predecessor Brendan Rodgers with some notable scalps including a 2-0 win away to Arsenal.
"If you look at the gap between us and the rest at the bottom it's quite big already," says Swansea's Dutch goalkeeper.
"We're ahead of where we were last season and that shows where we are going and where we want to go.
"Everybody told me the second year is the toughest, but we are trying to get established as a Premier League club and nobody talks about Swansea to go down this year.
"First and foremost the most important thing is to get to 40 points and then we will see where it ends."
Vorm was forced to miss two months of the current campaign due to a torn groin muscle, but despite only playing twice since returning to fitness the 29-year-old does not feel like he is playing catch-up.
"I almost forgot I was away which is strange because eight weeks is a long time," added Vorm.
"I have played only two games but I have already forgotten the injury and that's a good thing."