Running Qwen3.8-27B UD-Q2_K_XL 20.3 tok/s I think is beautiful to run a llm on a ps5!

1 comment

sorted by: hot top controversial new old
[–] 1 point 3 weeks ago

i wonder if it would be better to use bonsai-2 over a regular 2-bit quant 🤔

  • source