On Lemmy, even more so than Reddit, the hive mind is quick to downvote people who have different opinions.
I don't think that's true at all. I'd also argue Lemmy/Piefed is structurally more resistant to it on the grounds of upvotes/downvotes not being private.