Villa's 4-0 home defeat to Spurs on Boxing Day came in the wake of their 8-0 drubbing at Chelsea three days earlier.
But Villas-Boas, who like his opposite number was only appointed to his current post in the summer, believes Villa would be making a mistake if they were to sack Lambert.
"They were a different team at the beginning," said Villas-Boas.
"When Paul changed the structure to five at the back the results improved for them and they managed to get some important ones.
"I think for them now it is important to find stability defensively, looking at what is happening.
"I think Paul is the right person. He is developing a very young team, and it has nothing to do with teams of the past.
"So hopefully, by him being given time to do that, Villa can achieve the results they want."