Rafael Benitez was welcomed to his new role at Chelsea with jeering from the Stamford Bridge faithful when he took charge of his first game against Manchester City.
Arsenal boss Arsene Wenger also came in for some stick for his decision to substitute Olivier Giroud for Francis Coquelin during the goalless draw at Aston Villa.
Villas-Boas has had his fair share of abuse from the stands while at both Chelsea and Tottenham but says that is the supporters' prerogative.
"The fans have the right to everything in my opinion. They are the ones who breathe the biggest passion for the football club," said Villas-Boas.
"They are entitled to whatever they want to say or chant; disappointment, belief, encouragement, positiveness.
"It is all down to them, football is about them, it is about their passion. They have the right more than anybody to show that.
"(As a manager) you have to take it. Sometimes we don't like what we hear but that's life."