you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 1 year ago*

Be sure to grab a DWQ quant, like this:

https://huggingface.co/nightmedia/Qwen3-30B-A3B-Instruct-2507-dwq3-mlx

https://huggingface.co/models?sort=modified&search=DWQ

DWQ is like an enhanced MLX that's much stronger with tight quants around 3-4bpw.

  • source
  • parent