you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 1 year ago

It's awesome but that 128k context window is a throwback to Llama3 days

I bet the closed $ource model has like 2MB context

  • source