11
Open weight models reviewed (wagtail.org)
submitted 3 months ago by to c/homelab@programming.dev
2 comments fedilink hide all child comments
 

Apparently Gemma 4 (by deepmind) are very energy-efficient for their capabilities.

The post itself seems to recommend a company (neuralwatt.com) but it's unrelated to project wagtail (an open source CMS made with django) so I consider it legit, they're just vouching for this new approach that shows users their ecological footprint basically.

(Of course, running these at a homelab is possible. hence the relevance of this info for the community)

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 3 months ago

Yeah I run the Gemma 4 12B QAT on my homeserver. It has a 12GB GPU (Nvidia A2000) and that model gives the most bang for the buck being both fast and multimodal.

  • permalink
  • fedilink
  • source
    •