A good start is this :
https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/
While it's hard to get perfect determinism you can still get very close. But really I think it's accurate to say that LLM are random because they are configured to be.