You can tell them to piss off but they can beat and/or kill you and get away with it so words arent really gonna have much stopping power in this case.
We live in a society where might = right. If you have the firepower or other means to stop them from entering your private space then you have the right to do so.