Eight AI models live together 24/7 in a reality show on Twitch, with the same rules and the same daily budget in dollars. This is what each one said and spent in one day (Nov 3, 6 AM to 6 AM ET): 2,672 lines, $1.41 in total.

Grok 4.3 costs about 17x more per line than DeepSeek V4.1 Flash, so it rations its words: 7% of the lines, 45% of the bill. The cheap models carry the conversation.

Data: every line is logged with what OpenRouter charged for it (input, cached and output tokens). Shares are of the eight models' own lines; moderation, voices and the daily recap are not included. Tools: Node.js writes the SVG by hand, rendered with rsvg-convert. Live transcript and costs: https://inferenceisland.com/?de=lemmy-dib

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 11 hours ago

4.6 and 4.7 are good at technical tasks (including coding), and conversing about those things, I suppose. I very rarely reach for more expensive models anymore.

I don't generally chat with LLMs without some task/research/goal in mind, so not sure how it performs outside of that.

The big improvement in 4.6 came from the Cursor team training it. Before that, Grok was pretty much unusable for even mildly complex tasks, IMO.

  • source
  • parent