Sherwood took over from Andre Villas-Boas on an 18-month deal after he impressed in temporary charge of the first-team.
Since then Spurs have only lost two of their 12 games, and they sit in fifth place in the Premier League, but talk of other managers coming in to replace Sherwood next season continues to swirl.
Sherwood admits he has not quite got his side playing the way he wants, but he is baffled why people are judging his performance so harshly.
Asked if he has been given the recognition he deserves, Sherwood said: "No, probably not. People have been waiting for us to fail and lose some games.
"I don't know. I just think the perception is you cannot be a rookie manager and come in and be that good."
Sherwood goes head-to-head with Jose Mourinho on Saturday, with Spurs visiting Stamford Bridge in a vital game at the top of the Premier League, and while he would love to match Mourinho's success, Sherwood says there can be no comparison between their style.
"He is probably a different manager to how I would want to manage," he added. "Mourinho, as he has proved, goes into a club, gets backed by the chairman and buys the players to win instantly.
"I would see myself as more of a manager who builds something over time but I realise at the moment that is not possible because I have been dealt a hand here and I have to try to win games.
"I'm going from game to game to try to keep myself in a job.
"I honestly believe I can be a good manager, but I am realistic enough to know that you don't get given time.
"I think Liverpool is a good example. They gave Brendan time. Seventh last year and look at where he is now. It is a great example. And that team play football exactly how he wants them to play. But they had to take that step back.
"We are talking about Liverpool - a club that has won the Champions League many, many times and won loads of league titles."
Watch Chelsea take on Tottenham live on Sky Sports 1 on Saturday - coverage from Stamford Bridge starts at 5:00pm