It all began so well for the Saddlers at Bescot on Saturday, with Alex Nicholls hammering them ahead on 14 minutes after good work by Tony Macken.
But Walsall's defensive weaknesses were exposed when Andy Butler, playing against his old club, gave the ball away and Kevin Kilbane strolled through to net a simple equaliser on 19 minutes.
Six minutes later big defender Jamie McCombe headed Town in front from an Anthony Pilkington corner.
Walsall showed plenty of fight and equalised two minutes into the second half, top scorer Matt Richards grabbing his seventh of the season with a free-kick that took a deflection.
But more defensive errors allowed Huddersfield to go on to clinch the points, central defender Peter Clarke putting them in front again with an overhead kick from a corner. Then a howler by home keeper David Bevan wrecked his team's chances when he gave the ball away and Gary Roberts crossed for substitute Jordan Rhodes to drive home his 16th of the season.