you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 3 months ago

I'm surprised that the model's benchmark performance isn't that much worse than the base given that it's running with 1-bit quantization. Impressive.

  • source