So by that logic, Mexico City locals have no right to expect anyone to adapt to them? Plenty of people there are annoyed at foreigners who move in, never bother learning Spanish, and act like the neighborhood should work around them. Most people would call that a fair complaint. And before you say it's just about money, picture a broke backpacker doing the exact same thing. Same complaint, right?
If that's fair, then expecting newcomers to adapt isn't racist in itself. The real debate is about what's reasonable to expect, not whether it's allowed.
These are rhetorical questions, I don't want a response. I want you to think about how consistent you're being.