There are rumors about a new AI Chat coming soon based on Llama 3. Is that true? Don't get me wrong, the current AI Chat is great, but its goldfish memory ruins any chance to roleplay with an elaborate lore or world-building, not to mention the constant repetition of expressions like "maybe, just maybe" and so on.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 1 point 1 year ago (1 child)

Yeah, there are already models with millions of tokens like Gemini. I've been thinking about that a lot lately, and I think that will be fucking amazing. Imagine losing yourself in the world of your favourite game or novel, interacting with all the characters, creatures, and places. I think I will become a crazy old cat lady lol

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago*

    I think Llama 4 scout/maverick (forgot which one) has 10 million tokens, which is a huge upgrade over Llama 3.3's 128k tokens, so it went from 4k > 128k > 10m. as I said, the progress of Ai is terrifying, the only thing they need to do right now is to work on power efficiency because these models require at least five nuclear power plants to function properly. I heard somewhere that Llama 4 scout could be the new text model, but of course it won't have the 10m tokens, because that demands massive computational power that only mega corporations could pull off, so if the rumors are true and it's actually the chosen model, it will probably tuned down to 128k/200k, depending on the dev's hardware and how he's going to deal with it, if the rumors surrounding Llama 4 scout are a bunch of bull, then mistral small 3.1 or Llama 3.3 will be chosen instead.

  • source
  • parent