Deleted (aussie.zone)
๐Ÿ‘ 1
you are viewing a single comment's thread
view the rest of the comments
[โ€“] 2 points 5 months ago*

Probably Qwen 35B then. ~9GB free VRAM + (let's say) ~16GB of free CPU RAM is a good size for that, and squeezing bigger models in would be hard unless it's a headless linux server.

  • source
  • parent