I wouldn't be friends with someone who insisted on using slurs in my presence or engaged in intimate partner violence either, because I don't want those behaviors in my life.
You might not think it's harmful, but if I get a choice to hang out with people with shared values vs have to have awkward conversations asking people not to bring corpses to my house, I'm going to choose the vegans.