Goals from Danny Haynes, Yoann Arquin and Callum McGregor at Meadow Lane on Tuesday night handed County just their third win of the season in League One.
Adam Rooney and Jonson Clarke-Harris found the net for the Latics, who could not build on Saturday's victory over Swindon.
Johnson blasted Oldham's display and admitted he was too angry to confront his players after the game.
"Overall no complaints, other than with my players," he said.
"You realise how you miss players at times. When you have kids out on the pitch and they play like babies, you get nothing out of the game.
"We were so lucky to be one-all at half-time. We deserved nothing from the game on the basis of that first-half performance.
"I was thinking of making three substitutions after half an hour, we were that poor.
"We conceded two poor goals in the second half, standing way too far off their players and giving them way too much space.
"I am a bit angry and can't really talk to anyone in the dressing room. I'd end up having a fight with one of them.
"Clarke-Harris did well at times, he does a bit too much of this dramatic falling about at times, but I'll have a word with him about that."