Hmm, after running an LLM locally I'm not too surprised about low energy use while querying (but even then, 3Wh is very low, I was getting like 5 Wh per query while running DeepSeek locally, that said datacenter GPUs will be more efficient for this). But also, this doesn't go into great depths about the impact of training.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies: