I'm sure it will be fixed soon, but I just realized how much I am obsessed with ai chat. I fear a day where the site will be taken down or way or another. Is there any way to use the chat bot, preferrably with the same interface/able to load json files, to our computer? Would a gtx 1060 be able to run it?

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 year ago

You clearly don't know, otherwise you wouldn't be saying that Llama 3 has a bigger token count. The two are not related. Token count is directly related to how much VRAM you through at the model (barring special exceptions like Gemini 2.5 and some special builds using ROPE to extend context).

I also took a look at the dev's post history. At no point do they make mention of what model they plan to use. The only references to Llama are old mentions of the reddit channel "Local Llama" and stating that the current model is a popular 70b variant. That's it.

  • source
  • parent