Odejayi, on loan from Barnsley, struck with 10 minutes to go to give United victory and extend their unbeaten run under Aidy Boothroyd to six matches.
There was little goalmouth action in the first half, with left-back Marc Tierney coming closest to scoring for Colchester.
But the second half was a livelier affair, especially after Huddersfield defender Peter Clarke was sent off with 15 minutes to go after picking up two bookings in the space of ten minutes.
And barely three minutes later, Colchester took full advantage of Clarke’s absence when Odejayi tapped home a low cross by Lisbie, after he had got the better of left-back Joe Skarz.
Robbie Simpson was denied by Colchester goalkeeper Ben Williams and substitute Steven Gillespie curled over late on as the Essex club won again.