The 38-year-old goalkeeper is about to bring his association with the club as a player to a close, with his contract at St James' Park set to expire.
Harper is, however, a lifelong fan of the Magpies and a club stalwart who has spent 20 years on their playing staff.
He worked with Kinnear in 2008/09, when the Irishman took in a spell as manager, and claims to have enjoyed that period.
Kinnear's return to Tyneside as director of football has been met with scepticism by many Newcastle supporters - and has led Derek Llambias to leave his post as managing director - but Harper says the appointment 'makes sense' from a footballing perspective.
He told Sky Sports News: "Nothing surprises me at Newcastle.
"Given this morning's news as well, with Derek leaving the club, maybe it has become a bit clearer now that it may have been more of a like-for-like swap.
"Derek did a great job getting the club back on a financially sound platform and he's left the club and Joe comes in, who knows the club and knows the players.
"If it is a like-for-like swap, he's somebody with more of a football background and knowledge. It makes sense for the club."
Asked what Kinnear is like to work with, Harper added: "He was very likeable. He was larger than life, bubbly on the training ground.
"He came in at a difficult time at Newcastle, he came almost as a fire-fighter and was only there a few months. But that inside knowledge he has already of the club will stand him in good stead.
"Sadly back then he was taken ill before a game away at West Brom but, as always as a Newcastle fan, there's never a dull moment."