Tolerance doesn't mean someone can't be mean to you. It means they give you the same rights they expect you to give them.
This includes the right to say "get fucked" to others and to disassociate from people that are likely to say "get fucked" to you.