There is some of that happening, like when women get together and discuss how they're being treated it's "gossip" and implied as immoral.
I think some men might read what you've said and think you are denying any toxic gossip exists, it's important to have nuance and not alienate men who otherwise would be allies, but I think overall your point is well taken.