The Bayern Munich winger has been linked with a move back to the Premier League ever since Van Gaal revealed he was leaving the World Cup third-place playoff winners for Old Trafford before the tournament.
Robben, who previously played in England with Chelsea, revealed on Dutch television after the 3-0 win over Brazil in Brasilia that Van Gaal had approached him about joining United.
But despite their 'special bond' the 30-year-old has no plans to leave the Bundesliga side.
"I have a special bond with him. He is the most important coach in my career," Robben said.
"(Moving to United) is not an option though. I will stay at Bayern Munich."
Robben has been in top form under Van Gaal's stewardship at the World Cup.
He made the short list for player of the tournament after scoring three goals and making one assist during Holland's run to the last four, where they were beaten on penalties by Argentina.
Wouldn't want ya anyways, a talented player but god he wrecks my head, even just the way his arms move when he runs grates at me. If I was playing against him I'd just want to punch him- shea666