Guys who lash out like that are 100% looking for an excuse to assault LGBTQ+ people. I'm a straight cis guy, I've been approached by men and turn them down politely the same way I would a woman I wasn't interested in, no violence. The few guys who were handsy or inappropriate were dealt with by the community, no involvement from me needed.