Nigel Pearson's side have gone eight games without a win and slipped out of the play-off places.
But James feels the 1-1 draw at Brighton, which ended a run of three consecutive defeats, could give the players the confidence to snatch a top-six finish.
He told Leicester's official website: "We're gutted we didn't get the three points at Brighton.
"But in the past few weeks the performances haven't been great and I think the performance was good against Brighton.
"We've got two home games now and we've got to try and take maximum points from both those home games and just concentrate on one game at a time.
"If we start thinking about too many games and worrying about other teams then that's when the pressure starts to build. If we concentrate on ourselves I think we'll be there at the end of the season.
"I think that we always stick together. We all keep talking, keep working hard in training and I think that's the main thing, the concentration and knowing the job that we've got to do.
"The manager has been fantastic, especially in the last few weeks. He has kept us positive and we'll take the positives from the Brighton game and take that into Friday."