The burly forward missed the first leg on Sunday as he completed a three-match suspension.
Howard was in his best form of the season before he was shown a straight red card against Watford having scored three goals in the previous four games.
Assistant manager Craig Shakespeare believes the 34-year-old will have a crucial role to play in keeping Leicester's promotion dream alive.
"He was coming back into form prior to the sending off and in training he has been on fire - his effort, commitment and everything about him has been really good," said Shakespeare. "He will be an important player for us."
Leicester will assess the fitness of defender Wayne Brown and on-loan striker James Vaughan. The duo were left out of the squad for the first leg after picking up hamstring problems in training.