The club's first game since the departure of David Moyes resulted in a 4-0 victory at Old Trafford, their biggest home win of the season, and the team had more attempts than in any other Premier League game they'd played.
Wayne Rooney opened the scoring with a penalty shortly before half-time and scored again after the break before substitute Juan Mata added a brace of his own.
Former United striker Yorke, who was watching the game in the Sky Sports studio, believes interim manager Giggs gave the players the freedom to go out and enjoy playing football again.
"I think it's been an outstanding debut for him," he told Saturday Night Football.
"He'll be delighted with the players. The first half wasn't great, but they got that decisive goal and really came out in the second half and took the game by the scruff of the neck. They scored three further goals and Wayne Rooney was outstanding all afternoon.
"The first half was a little bit of a mis-hit. The goal that was scored just before the end of the first half really changed things around, but in the second-half once they got the second goal, the players seemed to let that tension off them.
"They came out and expressed themselves a lot more. They seemed to get on the ball, people wanted the ball - and most importantly the end product was there as well.
"At Old Trafford it's been a very difficult time for them this year and the freedom, the enjoyment, the happiness on their face and the expressiveness of the football, was very evident in their performance."
Fellow Sky Sports pundit Jamie Redknapp was impressed with how Giggs handled the media in his press conference on Friday - and said the performance on the pitch was just as confident.
And despite the bookmakers installing Netherlands coach Louis van Gaal as the favourite for the full-time job, he believes the supporters would prefer to see the Welshman handed the reins.
"The goal changed it and gave them a little bit of confidence and belief," Redknapp said.
"If it was an audition for Ryan Giggs it couldn't have gone any better, from yesterday in the press conference to today and the way the team played.
"They weren't at their best, but what Man United have always done throughout the years is still score goals when they're not at their best.
"He looks every inch a Man United manager to me. I'm not sure what the plans are, but if he carries on like that in the next three games there will be a clamour from those fans.
"They will want him, make no mistake about it."