you are viewing a single comment's thread
view the rest of the comments
[–] [S] 2 points 18 hours ago

I offload mmproj to the CPU to keep as much model weights in VRAM as possible 🙂

  • source
  • parent