you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 year ago

Ah, multiple GPUs? For some reason I thought you meant that with exllamav3 you had managed to load a model which was larger than your VRAM.

  • source
  • parent