This happens when your people don't respect or like you.
If you had either of those you wouldn't be bullied by them.