Flores was involved in an incident which led to the dismissal of West Ham striker Andy Carroll during Swansea's 2-0 defeat at Boleyn Ground last Saturday.
Carroll failed in his appeal against the red card on Tuesday and Flores, who had a disagreement with Hammers boss Sam Allardyce in a previous clash between the teams, has hit back at people targeting him through the internet.
"I'm a bit tired of the strong insults from the West Ham fans. Whoever doesn't see the aggression in that action is blind," Flores said.
"They should be more preoccupied with the ugly way their team play football: always making very long passes and never quick short passing.
"They should be worried about that before caring about such evident things."