But is it actually better than Ornith or Tiel 35b-a3b?
I'm looking at around 30-50k context until I start running out of room.
I can do 80k+ just fine with 35b-a3b. I don't think 50k would be enough for agentic coding.
But is it actually better than Ornith or Tiel 35b-a3b?
I'm looking at around 30-50k context until I start running out of room.
I can do 80k+ just fine with 35b-a3b. I don't think 50k would be enough for agentic coding.
Put the name in the headline.
I just block folks who post things with no real information in the post.
Lemmy's not big enough for that. You're losing a significant portion of all posts, mostly thanks to sites themselves doing clickbait nonsense.
I'll have to try this out. I couldn't get Microsoft's ternary bitnets running on llama.cpp or ollama.
all 19 comments