Brady was last man when he tripped Wilfried Zaha as he raced towards the goal but the Tigers man escaped with a booking.
And after watching his side claw their way back into the match, Holloway felt that could have been the point when Palace snatched something from the match.
"They said his touch went too far and rolled to the goalie," said Holloway. "Their fellow didn't play the ball and that ruined his touch.
"As we all know, he would have probably outpaced him, got past him and then that would have been a goalscoring opportunity. So it was all a bit strange.
"Hull had the better of the first half. I felt we didn't get to grips with their shape and what they were doing.
"I'm relieved to be 0-0 at half-time and in the second half I thought the longer it went on, the more imposing we got. We looked pretty good as the game went on and that is full credit to the lads."