Seems like smarter and more efficient quants than normal

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 2 months ago (3 children)

There's no point in this if one runs Q8 right? I guess could save VRAM by dropping down from Q8 to say UD Q6.

  • source
  • hideshow 3 child comments