Their own thing is oppressing people. We should stop that much as far as we have power to , and if we can force them out of the union that's likely from a position where we would.
You would allow the people in those states to be oppressed just to make your own life easier. Yes, you are wrong