you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 year ago (1 child)

Interesting, I had assumed that turning down temperature to 0, or hardcoding a seed would make LLM inference deterministic.

Especial after watching this video https://youtu.be/J9ZKxsPpRFk

  • source
  • parent
  • hideshow 1 child comment