So people unsubscribed from other instances, etc could still downvote and harm a posts visibility across the fediverse.
Are you absolutely certain of that - that is not what the feature description seems to indicate? If true, that sounds like a bug request should be submitted, either to fix the feature itself or at least the description to match, although I do not moderate any communities on PieFed so I lack personal experience with this and will have to leave it to you who knows.
I would have naively guessed that it would be trivially easy for PieFed to know which users were subscribed to a community vs. not, but maybe it's in an inaccessible form or something.