You'd have to start soldering the HBM and the GPU chips off the boards they're on. Those aren't PCI-E boards much of the time. Also, they don't have display outputs.

I'd absolutely buy one of those servers to run open-weight models locally, but let's not kid ourselves here: We're talking about an ungodly amount of power for a single machine, think it was a few megawatts for a rack, or at least hundreds of kilowatts. A single server luckily should still be in two digit kilowatts. Could realistically only use it in the winter though.