That's a fair point. I think in most cases I would want to be upvoting a post and all of its cross posts, but there are cases where I wouldn't want to upvote it in other communities.
For instance, a post that you like might get cross posted to something like c/facepalm. If you disagreed with that assessment, you wouldn't want your vote to be applied in that way.