Milan Lalkovic gave the visitors the lead in the 19th minute and they looked like holding out, even after Ben Purkiss was sent off in the 73rd minute for his second yellow card of the afternoon.
But Rotherham finally came good in the 88th minute when Alex Revell headed on for substitute Nicky Adams to slam in the equalizer off the underside of the bar.
Evans admitted afterwards that he was disappointed not to win.
"We did enough to win it," he claimed.
"We probably lacked a yard in the first half," he said. "And lacked a bit of composure. But we had that in the second half and we had a go, but my biggest complaint of the afternoon is that after five minutes we should have had a penalty. If that's not a penalty on Wes Thomas I don't know what is.
"I've just looked at it again and it was a blatant penalty, but Rotherham United don't get penalties, but we've got a point and the character was there again, but the quality from key players was a little bit down.
"Walsall are a good side, but there is always a plus point. First half we huffed and puffed and should have had a penalty, but my players have given me everything and I never thought in the second half that we wouldn't get the goal."