Hi All, I just got a P100, and although it appears to work, i cant quite get gemma4 to run on it properly.

My setup is:

  • Ubuntu 22.04 VM
  • PCI passthrough the GPU (Connected via thunderbolt) (I know this is unideal, and I might try cut this out later)
  • Nvidia 580 driver installed.
  • llama.cpp built from source, with cuda enabled.

I got some mostly normal output from qwen, but whenever I try to load gemma4 I get a lot of <unused49><unused49><unused49><unused49>. I did have it briefly working, no idea what changed, but reboot and its back to unused spam.

Anyone hit this before? Ideas on what I should try change?

you are viewing a single comment's thread
view the rest of the comments
[–] 0 points 2 months ago (1 child)

Idk if this is a thing but there is no motherboard to control voltages and you may fry your GFx card that way

  • source
  • parent
  • hideshow 1 child comment
  • [–] [S] 1 point 2 months ago*

    Nah, the PSU controls the voltages. All the motherboard does is turn on the PSU by shorting the green PS-ON wire in the mobo cable to ground. The thunderbolt card actually came with a switch to do that, normally I use a paperclip :D.

    http://bitsavers.informatik.uni-stuttgart.de/pdf/intel/ATX/ATX_Specification_2.01_199702.PDF

    PS-ON is an active low signal that turns on all of the main power rails including 3.3V, 5V, -5V, 12V, and -12V power rails. When this signal is held high by the PC board or left open circuited, outputs of the power rails should not deliver current and should be held at a zero potential with respect to ground. Power should be delivered to the rails only if the PS-ON signal is held at ground potential. This signal should be held at +5VDC by a pull-up resistor internal to the power supply.

    Here is an example of a switch: https://a.aliexpress.com/_msxxnjv Mine doesn't have the third wire, I think its just for powering the switch LED though.

  • source
  • parent