Hi All, I just got a P100, and although it appears to work, i cant quite get gemma4 to run on it properly.

My setup is:

  • Ubuntu 22.04 VM
  • PCI passthrough the GPU (Connected via thunderbolt) (I know this is unideal, and I might try cut this out later)
  • Nvidia 580 driver installed.
  • llama.cpp built from source, with cuda enabled.

I got some mostly normal output from qwen, but whenever I try to load gemma4 I get a lot of <unused49><unused49><unused49><unused49>. I did have it briefly working, no idea what changed, but reboot and its back to unused spam.

Anyone hit this before? Ideas on what I should try change?

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 months ago (2 children)

Definitely does not require only GUI.

  • source
  • parent
  • hideshow 2 child comments
  • [–] [S] 1 point 2 months ago (1 child)

    I'll have another go, but the install instructions didn't work well on 2204.

    The apt method doesnt work, they don't seem to have a 2204 repo, and the snap method started to download gnome...

  • source
  • parent
  • hideshow 1 child comment
  • [–] [S] 1 point 2 months ago

    Building it from source was pretty fruitless, the cmake scripts give a version error despite having an "accepted" cmake version. Upgrading got me further, but still failed to build.

    Increasing the system memory works, so I'm happy for now.

  • source
  • parent