you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 year ago (1 child)

Unsloth did a test and their dynamic quants were competitive even at 1 bit in aider benchmark https://docs.unsloth.ai/new/unsloth-dynamic-ggufs-on-aider-polyglot

  • source
  • parent
  • hideshow 1 child comment