you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 month ago

Great model. The best so far for my usage (agents and coding). I can get 15t/s on my dual rtx a4000 setup. I use the Q5, with 300k context.

  • source