Yeah. The whole thing is stupid. I'm moderately confident that this is either:

1. People ganging up as a very organized effort to try to bully you out of the space as they did FlyingSquid, when you (I think with every righteous reason) decide this bullshit is unpleasant and unfair and you don't feel like putting up with it anymore. I've already semi-abandoned the political spaces on lemmy.world, not even because I was getting bullied with any level of success, but just because the overall flavor of the interaction is so toxic and fact-free.
2. People who are just operating on pure tribalism. It's fine for them to accuse you of all kinds of stuff you objectively didn't do, call you a twat and a loser, all kinds of stuff. It's not fair for you to argue about politics or downvote people, those are evidence of toxicity and sins. Because they're on the "right" team and you're on the "neoliberal enemy" team, so they can do what they want, you can't. Reminiscent of a popular political viewpoint in the US...

Honestly, I wouldn't even stress about it. I get the impulse to try to defend yourself vigorously from this stuff but they're not going to listen to anything sensible anyway, and they'll be able to cherry pick instances of you getting upset to use later as proof that you're some kind of monster. If you want my advice about how to look at it.