1 comment

sorted by: hot top controversial new old
[–] 2 points 3 months ago

I'm surprised that the model's benchmark performance isn't that much worse than the base given that it's running with 1-bit quantization. Impressive.

  • source