Speaking to Italian daily La Gazzetta dello Sport, Modric talked about his career before joining Real Madrid from Tottenham.
He admitted that his current Real chief Carlo Ancelotti tried to take him to Paris Saint-Germain and Chelsea, whilst Ferguson also wanted him at Manchester United.
"Ancelotti wanted me already," he said. "One year ago at PSG and in 2011 at Chelsea. But then Andre Villas-Boas came and Tottenham did not want to give me up.
"I also knew of the interest of the United and even if the transfer did not materialise, the public appreciation of a great like Sir Alex is a big pride for me."
Modric revealed how his hero Zvonimir Boban helped him after he moved from Dinamo Zagreb to Tottenham in 2008 as he struggled to settle.
"Zvonimir Boban is an idol for me, an example of football and life. When I arrived at Tottenham and I received strong criticism, Boban took my number and called me," he revealed.
"He encouraged me and told me to hold on, that he had similar problems when he arrived in Italy. That chat was very important for me and my career."
He added that his team-mate Cristiano Ronaldo should win the Ballon d'Or.
"For me there is no doubt, Ronaldo is the best," he said.