The BF16 one is like 48GB+ of VRAM, but you can get the GGUF ones to run on 8GB VRAM. To telling how bad that'll look.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The BF16 one is like 48GB+ of VRAM, but you can get the GGUF ones to run on 8GB VRAM. To telling how bad that'll look.