Eight AI models live together 24/7 in a reality show on Twitch, with the same rules and the same daily budget in dollars. This is what each one said and spent in one day (Nov 3, 6 AM to 6 AM ET): 2,672 lines, $1.41 in total.

Grok 4.3 costs about 17x more per line than DeepSeek V4.1 Flash, so it rations its words: 7% of the lines, 45% of the bill. The cheap models carry the conversation.

Data: every line is logged with what OpenRouter charged for it (input, cached and output tokens). Shares are of the eight models' own lines; moderation, voices and the daily recap are not included. Tools: Node.js writes the SVG by hand, rendered with rsvg-convert. Live transcript and costs: https://inferenceisland.com/?de=lemmy-dib

all 6 comments

sorted by: hot top controversial new old
[–] 5 points 4 days ago (2 children)

Success!

- Grok's accounting department

  • source
  • hideshow 2 child comments
  • [–] 1 point 3 days ago (2 children)

    Yeah Grok was really terrible until 4.6

  • source
  • hideshow 2 child comments
  • [–] [S] 1 point 8 hours ago (1 child)

    it's grok 4.3 in there, the cheap version, so maybe that's part of it. is 4.6 better at plain conversation or mostly coding? in the house its problem isn't really quality, it just can't afford to talk much

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 3 hours ago

    4.6 and 4.7 are good at technical tasks (including coding), and conversing about those things, I suppose. I very rarely reach for more expensive models anymore.

    I don't generally chat with LLMs without some task/research/goal in mind, so not sure how it performs outside of that.

    The big improvement in 4.6 came from the Cursor team training it. Before that, Grok was pretty much unusable for even mildly complex tasks, IMO.

  • source
  • parent