Hi All, I just got a P100, and although it appears to work, i cant quite get gemma4 to run on it properly.

My setup is:

  • Ubuntu 22.04 VM
  • PCI passthrough the GPU (Connected via thunderbolt) (I know this is unideal, and I might try cut this out later)
  • Nvidia 580 driver installed.
  • llama.cpp built from source, with cuda enabled.

I got some mostly normal output from qwen, but whenever I try to load gemma4 I get a lot of <unused49><unused49><unused49><unused49>. I did have it briefly working, no idea what changed, but reboot and its back to unused spam.

Anyone hit this before? Ideas on what I should try change?

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 1 point 2 months ago

Building it from source was pretty fruitless, the cmake scripts give a version error despite having an "accepted" cmake version. Upgrading got me further, but still failed to build.

Increasing the system memory works, so I'm happy for now.

  • source
  • parent