Lemme do some thinking for you: If you have a bunch of aggressive people who say they’re going to harrass men in the women’s restroom, and who do not accept that trans women are women, then you need to be worried about the safety of trans women.
If someone believed that all puppies were the spawn of the devil and said they were going to kill them all on sight you wouldn’t go “well I don’t believe they are the spawn of the devil so obviously there is no danger.”