you can’t put everything you want into a setting just because it’s fantasy/fictional.
Yes, you can. That is literally the idea.
But it has to be believable and fleshed out. I never read the WoT book, but the TV show I half finished did feel like a mess, heh, though I didn't stop midway because of cultural weirdness. It just felt... boring, and the world wasn't interesting.
Witcher is largely drawn from celtic lore, and in the world it sets up, people being kinda pastey faced makes sense. But I brought up KCD2 because it's mostly white Europeans is a more grounded and historical (Germanic?) region, yet there are still distinct local subcultures and distinct travelers, like gypsies and that turkish guy. There is plenty of PoC. You should play KCD2 if you haven't already, as if you're going for 'authentic medieval,' no other game comes close.
...On the other hand, look at the setting of Avatar: The Last Airbender or the Kyoshi Novels. It's transitioning out of middle-ages tech and culture, yet has a mash of different skin tones and inspirations. Chinese, Japanese, Southern US, Inuit, Mesoamerican, Indian, you name it. And it works perfectly, because they build those people up and flesh them out.
In other words, authenticity doesn't matter in fiction/fantasy because you're building the world. The reason for a mix of 'PoC' is whatever one makes.