617
ChatGPT 5 power consumption could be as much as eight times higher than GPT 4 — research institute estimates medium-sized GPT-5 response can consume up to 40 watt-hours of electricity (www.tomshardware.com)
submitted 1 year ago by to c/technology@lemmy.world
132 comments fedilink hide all child comments
 

The University of Rhode Island's AI lab estimates that GPT-5 averages just over 18 Wh per query, so putting all of ChatGPT's reported 2.5 billion requests a day through the model could see energy usage as high as 45 GWh.

A daily energy use of 45 GWh is enormous. A typical modern nuclear power plant produces between 1 and 1.6 GW of electricity per reactor per hour, so data centers running OpenAI's GPT-5 at 18 Wh per query could require the power equivalent of two to three nuclear power reactors, an amount that could be enough to power a small country.

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 1 year ago* (1 child)

Technologies come and go, but often when a worldwide popular one vanishes, it's because it got replaced with something else.

So lets say we need LLM's to go away. What should that be? Impossible to answer, I know, but that's what it would take.

We cant even get rid of Facebook and Twitter.

BUT that being said. LLMs will be 100x more efficient at some point - like any other new technology. We are just not there yet.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 8 points 1 year ago* (last edited 1 year ago)

    @themurphy @rigatti There is one difference ... LLM's can't be more efficient there is an inherent limitation to the technology.blog.dshr.org/2021/03/internet In 2021 they used 200PB and they for sure didn't make a copy of the complete internet. Now ask yourself if all this information without loosing informations can fit into a 1TB Model ?? ( Sidenote deepseek r1 is 404GB so not even 1TB ) ... local llm's usually < 16GB ... This technology has been and will be never able to 100% replicate the original informations. It has a certain use ( Machine Learning has been used much longer already ) but not what people want it to be (imho).

  • permalink
  • fedilink
  • source
  • parent