you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 3 months ago (3 children)

Of course all this will collapse when the bills come due and people have to pay the actual cost of LLM "tokens". As users of Microsoft's Copilot found out not long ago.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 3 months ago (2 children)

    I mean, you can put caps on token usage at the user level. Also, you can test while building so you have an estimated cost per run.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 3 months ago (1 child)

    When you look at the costs involved, putting caps on means you run out of tokens in your first morning of use per month.

    The sticker shock for the Copilot users was a couple orders of magnitude.

  • source
  • parent
  • hideshow 1 child comment