Adkins - who guided the club to back-to-back promotions - has been replaced by former Argentina international Mauricio Pochettino, who left his coaching role at Espanyol in November.
Soccer Saturday pundit Le Tissier told Sky Sports News: "It doesn't surprise me.
"It's a strange time of the season, they've lost two of the last 12 games and came from 2-0 down to draw at Chelsea.
"But it seems to be the way the club's being run under the chairman. Nothing's surprising and it's a bit of a laughing stock.
"I'm shocked at the timing, it's very strange and it's an odd thing to come to terms with today.
"I think he had a bit of pressure early on this season, people thought it might happen then; maybe they couldn't get the man they wanted then. It's all very strange.
"I think everyone is taken aback by it all. They have come to terms with life in the Premier League, had a tough start and have turned things round pretty well."
Pochettino will be in charge for the home match against Everton on Monday night, which will be shown live and exclusively on Sky Sports 1HD.