Agreed. Hate the data centers and corporate obsession with extreme waste for total value capture. Not the tech, especially on a local scale.

A 128GB amd strix halo runs at 120W and can host large LLMs at home. If you ran it full time for inference it would still be under $20/mo in electricity costs.