you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 4 months ago

So my GPU is about 300 watts and a still blatantly stupid LLM can write a little faster than me. Take off 100w to bring that down to my own writing speed then make it 10x slower to turn that 200 watts into 20 watts. Even with that heavy bias in the LLMs favour (forgiving it the entire power cost of my PCs other components that it partially utilizes) what we get is something slow, dumb, and incapable of learning because any local model is statically weighted.

  • source
  • parent
  • [+] 1 point 4 months ago (1 child)
  • [–] 4 points 4 months ago

    Do I get to include the gargantuan cooling system for the data centre and all the infastructure required to keep that going?

  • source
  • parent
  • [+] 2 points 4 months ago (1 child)
  • [–] 1 point 4 months ago

    Agreed, and therefore an AI will always use more. As they required all of us, doing shit this big, for this long, to function. So, since each of us required a whole civilization to get to this moment, we're back to where we started, crossing off every externality and only counting direct power usage for the task at hand.

  • source
  • parent
  • [–] 1 point 4 months ago* (-1 children)

    Humans living is the whole point of civilization, though. We don't need the LLM to pay for the techbro carbon footprint or olichsrch child abuse, so we should similarly exclude the human's base sustensnce and survival from their budget.

    You can include the human writer's coffee, music, and writing snacks / cigarettes.

  • source
  • parent
  • hideshow -1 child comments
  • load more comments (-2 replies)
  • load more comments (-2 replies)
  • load more comments (-2 replies)