Randomness is added deliberately, see https://axldpi.substack.com/p/why-are-llms-not-deterministic

Pushing a big rock down a hill is non-deterministic too irl (not really, but can't be reproduced).