A week ago they were beaten on penalties at the semi-final stage of the league cup before slipping up at St Mirren in the SPL on Wednesday.
Paul Heffernan netted twice for the hosts during the second half - the decisive second goal five minutes from time - while Inverness lost skipper Richie Foran and Andrew Shinnie to injury.
A disappointed Butcher said: "Your captain and most influential player gets taken off in the first half and it was always going to be difficult from there on.
"I look at their bench and see (Manuel) Pascali, Heffernan and (Garry) Hay and people like that and our bench is made up of young kids.
"Our young kids came on and did well and got into the game but it was going to be hard."
As for Foran's injury, Butcher added: "We will get it scanned and we will see but someone landed on his knee. It must have been bad for Richie to come off.
"I don't think Andy's that serious. His hamstring is tight but it has not snapped or torn.
"But that's the way it goes. It wasn't our day."