you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 year ago (3 children)

You sent me down a bit of a rabbit hole, but it turned up an interesting answer. Turns out they are nondeterministic, and why they aren't deterministic is still an open question https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/

  • source
  • parent
  • hideshow 3 child comments