They find strong sweaty guys sexy and are confused by it (because they are obviously not gay), so they refuse it and project it as feminime man = gay = bad, and by extension, man doing feminime thing = weak (because feminime) = bad. People who never really learned to reason and question.