Barnett moved from London Road to Ipswich on loan last week after he was placed on the transfer list following a police caution for an incident on a night out in Peterborough city centre.
"Obviously I'm contracted there so that is my parent club," Barnett told BBC Radio Suffolk. "But if I could get away I would be delighted.
"There's always regrets because I didn't want to leave the club in the way that I did. I'd rather it be on good terms. But that's life. You take it, get on with it and hopefully I can move on.
"I'd say [to Ipswich fans] take it with a pinch of salt. The lads and people who know me know I'm not a troublemaker or whatever people want to come up with.
"When you get to know me I'm an all right guy."