The University of Rhode Island's AI lab estimates that GPT-5 averages just over 18 Wh per query, so putting all of ChatGPT's reported 2.5 billion requests a day through the model could see energy usage as high as 45 GWh.

A daily energy use of 45 GWh is enormous. A typical modern nuclear power plant produces between 1 and 1.6 GW of electricity per reactor per hour, so data centers running OpenAI's GPT-5 at 18 Wh per query could require the power equivalent of two to three nuclear power reactors, an amount that could be enough to power a small country.

top 98 comments

sorted by: hot top controversial new old
[–] 110 points 1 year ago* (last edited 1 year ago) (9 children)

I have an extreme dislike for OpenAI, Altman, and people like him, but the reasoning behind this article is just stuff some guy has pulled from his backside. There's no facts here, it's just "I believe XYX" with nothing to back it up.

We don't need to make up nonsense about the LLM bubble. There's plenty of valid enough criticisms as is.

By circulating a dumb figure like this, all you're doing is granting OpenAI the power to come out and say "actually, it only uses X amount of power. We're so great!", where X is a figure that on its own would seem bad, but compared to this inflated figure sounds great. Don't hand these shitty companies a marketing win.

  • source
  • hideshow 9 child comments
  • [–] 3 points 1 year ago* (6 children)

    This figure is already not bad. 40 watt hours = 0.04kWh - you know kWh? That unit on your electric bill that is around $0.18 per kWh (and data centers tend to be in lower cost electric areas, closer to $0.11/kWh.) Still, 40Wh would register on your home electric bill at $0.0072, less than a penny. For comparison, an average suburban 4 ton AC unit draws 4kW - that 40Wh request? 1/100th of an hour of AC for your home, about 36 seconds of air conditioning. I don't know that this article is making anybody "look bad" in terms of power used.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 1 point 1 year ago (5 children)

    What exactly do you get for that power though?

    The point is that it's too much power for little gain in return.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 1 year ago* (4 children)

    Arguably, a great deal more than the energy you lose from opening the door to your house in the summer, once while the A/C is running.

    Or, looking at it another way, an AI query+result can be just as valuable as a Tik Tok post / view.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 1 year ago (3 children)

    I consider TikTok harmful, so you are right about your last sentence.

    But my AC does not nor ever has actually consumed 4kW in an hour.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago (2 children)

    The average (US suburban 2200sq ft) home's A/C does consume 4kW while it is cycled on, and in the hotter than normal months of summer it can run continuous duty cycle for hours on end.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago (1 child)

    You need better insulation then. That's crazy. Also outdoor blinds.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago

    Me, personally, we have trees and shade. So many subdivisions don't, and they have dark colored roofs, and then homeowners do bone-headed things like adding "sun rooms" - lots of those in Houston.

    We get upset when our electric bill passes $300 for the month, but our neighbors with the 3500 sq ft? They never see it under $400.

  • source
  • parent
  • [–] 1 point 1 year ago

    Yeah, I saw some people speculating GPT-5 is having worse performance in some tasks than older models but still being forced to everyone because it's a consolidation and cost cutting version, but how could it be cutting costs if it consumes 8 times more power?

  • source
  • parent
  • [+] 21 points 1 year ago (3 children)
  • [–] 7 points 1 year ago

    People who fawn over generative AI haven't tried to use it for more than 5 seconds. I wish it could run a ttrpg game for me or even just remember the details of its original prompt but its not even close.

  • source
  • parent
  • [–] 2 points 1 year ago*

    Well yeah, it's a for-profit company. They exist solely to make money, that's their entire goal.

    It's almost all marketing and has been for a while. ChatGPT peaked with 4o (and 4.5 if you used their API), 4.1 was a step backwards despite them calling it an improvement, and 5 was another step backwards.

    They are not any closer to AGI, and we're not going to see AGI from LLMs no matter how much they claim just how close we are to seeing AGI.

  • source
  • parent
  • [–] 17 points 1 year ago* (5 children)

    For reference, this is roughly equivalent to playing a PS5 game for 4 minutes (based on their estimate) to 10 minutes (their upper bound)

    calulationsource https://www.ecoenergygeek.com/ps5-power-consumption/

    Typical PS5 usage: 200 W

    TV: 27 W - 134 W → call it 60 W

    URI's estimate: 18 Wh / 260 W → 4 minutes

    URI's upper bound: 48 Wh / 260 W →10 minutes

  • source
  • hideshow 5 child comments
  • [–] 3 points 1 year ago* (2 children)

    I was just thinking, in more affordable electric regions of the US that's about $5 worth of electricity, per thousand requests. You'd tip a concierge $5 for most answers you get from Chat GPT (if they could provide them...) and the concierge is likely going to use that $5 to buy a gallon and a half of gasoline, which generates a whole lot more CO2 than the nuclear / hydro / solar mixed electrical generation, in reasonably priced electric regions of the US...

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 1 year ago* (last edited 1 year ago) (1 child)

    That doesn't seem right. By my calculations it should be like 5¢. Can you show your work?

    Edit: didn't read. You said "per thousand requests."

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago

    Depends on your electric rates, of course. The gotcha in this statement is "per thousand requests" which cranks up the power usage from 40 watt-hours to 40 kilowatt hours. Say you've got "affordable" electricity at 12.5 cents per kilowatt hour: 40 * .125 = 5.

  • source
  • parent
  • [–] 15 points 1 year ago* (19 children)

    I don’t buy the research paper at all. Of course we have no idea what OpenAI does because they aren’t open at all, but Deepseek's publish papers suggest it’s much more complex than 1 model per node… I think they recommended like a 576 GPU cluster, with a scheme to split experts.

    That, and going by the really small active parameter count of gpt-oss, I bet the model is sparse as heck.

    There’s no way the effective batch size is 8, it has to be waaay higher than that.

  • source
  • hideshow 19 child comments
  • [–] 8 points 1 year ago (18 children)

    And perhaps even more importantly, the per-token cost of GPT-5's API is less than GPT-4's. That's why OpenAI was so eager to move everyone onto it, it means more profit for them.

  • source
  • parent
  • hideshow 18 child comments
  • [–] 9 points 1 year ago (11 children)

    I don’t believe api costs are tied all that closely to the actual cost to openAI. They seem to be selling at a loss, and they may be selling at an even greater loss to make it look like they are progressing. The second openAI seems like they have plateaued, their stock evaluation will crash and it will be game over for them.

  • source
  • parent
  • hideshow 11 child comments
  • [–] 1 point 1 year ago (10 children)

    I based my argument on actual numbers that can be looked up and verified. You "believe" that they "seem" to be doing something else. Based on what?

  • source
  • parent
  • hideshow 10 child comments
  • [–] 9 points 1 year ago* (8 children)

    Their point is that those API prices might not match reality, and the prices may be artificially low to build hype and undercut competitors. We don't know how much it costs OpenAI, however we do know that they're not making a profit.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 5 points 1 year ago (4 children)

    Or it might not. It would be a huge short term risk to do so.

    As FaceDeer said, that we truly don't know.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 6 points 1 year ago (3 children)

    OpenAI are not profitable today, and don't estimate they'll be profitable until 2029, so it's almost guaranteed that they're selling their services at a loss. Of course, that's impossible to verify - since they're a private company, they don't have to release financial statements.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 4 points 1 year ago (1 child)

    That’s not what I’m saying. They’ve all but outright said they’re unprofitable.

    But revenue is increasing. Now, if it stops increasing like they’ve “leveled out”, that is a problem.

    Hence it’s a stretch to assume they would decrease costs for a more expensive model since that would basically pop their bubble well before 2029.

  • source
  • parent
  • hideshow 1 child comment
  • There's a difference between selling at a loss, and having a loss.

    OpenAI let's people use models for free with very little limits other than reducing the model quality over time, and they have very generous limits before they limit you at that.

    That all costs money and is a loss for them.

    If they get someone who's willing to pay, and they charge $20/m and on average, they net $5 profit per customer, they aren't selling it at a loss, they just need more customers. It's possible that a paid customer uses it even more though and it actually does incur a loss per paid customer and they're doing that to try and gain users while they figure out how to lower their costs, but that seems less likely.

  • source
  • parent
  • [–] 1 point 1 year ago (2 children)

    Sure, they might not. But he gives no basis for saying that other than what he "believes."

    People in this community, and on the Fediverse in general, seem to be strongly anti-AI and would like to believe things that make it sound bad and unprofitable. So when an article like this comes along and says exactly what you want to believe it's easy to just nod and go "knew it!" Rather than investigating the reasons for those beliefs and risking finding out something you didn't want to know.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 7 points 1 year ago* (1 child)

    that make it sound bad and unprofitable

    It is unprofitable, though.

    OpenAI recently hit $10 billion in ARR and are likely to hit $12.7b by the end of the year, but they're still losing a lot of money. They don't think they'll make a profit until 2029, and only if they hit their target of $125 billion revenue. That's a huge amount of growth - 10x in 4 years - so I'm interested as to if they'll actually hit it.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 0 points 1 year ago

    Okay, make it sound worse and even more unprofitable.

    Making their AI models cheaper to run (such as by requiring less electricity) is one step along that path to profitability.

  • source
  • parent
  • [–] 8 points 1 year ago

    To be fair, OpenAI's negative profitability has been extensively reported on.

    Your point stands though; there's no evidence they're trying to decrease revenue. On the contrary, that would be a huge red flag to any vested interests.

  • source
  • parent
  • [–] 2 points 1 year ago (5 children)

    How does OpenAI getting less money (with a cheaper model) mean more profit? Am I missing something?

  • source
  • parent
  • hideshow 5 child comments
  • [–] 8 points 1 year ago (3 children)

    Usually, companies will make their product say 25% cheaper to produce, then sell it to the public at a 20% discount (while loudly proclaiming to the world about that 20% price drop) and pocket that 5% increase in profits. So if OpenAI is dropping the price by x, it's safe to assume that the efficiency gains work out to x+1.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago* (2 children)

    Thanks! This makes sense, however OpenAI are not yet profitable. It's definitely possible that they're losing less money with the new models, though.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago (1 child)

    That "not profitable" label should be taken with a grain of salt. Startups will do all the creative accounting they can in order to maintain that label. After all, don't have to pay taxes on negative profits.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago

    In the end, it still means their losses are greater than their profits.

    They've still got taxes they need to pay, too - things like payroll taxes, real estate taxes, etc.

  • source
  • parent
  • [–] 1 point 1 year ago

    If the model is cheaper to run then they are able to reduce the price without reducing profit, which gives them an advantage over competitors and draws in more customer activity. OpenAI is far from a monopoly.

  • source
  • parent
  • [–] 42 points 1 year ago (13 children)

    I think AI power usage has an upside. No amount of hype can pay the light bill.

    AI is either going to be the most valuable tech in history, or it's going to be a giant pile of ash that used to be VC capital.

  • source
  • hideshow 13 child comments
  • [–] 17 points 1 year ago (11 children)

    It will not go away at this point. Too many daily users already, who uses it for study, work, chatting, looking things up.

    If not OpenAI, it will be another service.

  • source
  • parent
  • hideshow 11 child comments
  • [–] 19 points 1 year ago (4 children)

    Those same things were said about hundreds of other technologies that no longer exist in any meaningful sense. Current usage of a technology, which in this specific case I would argue is largely frivolous anyway, is not an accurate indicator of future usage.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 1 year ago (3 children)

    Can you give some examples of those technologies? I'd be interested in how many weren't replaced with something more efficient or convenient.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 11 points 1 year ago

    https://en.wikipedia.org/wiki/Dot-com_bubble

    There were certainly companies that survived, because yes, the idea of websites being interactive rather than informational was huge, but everyone jumped on that bandwagon to build useless shit.

    As an example, this is today’s ProductHunt

    And yesterday’s was AI, and the day before that it was AI, but most of them are demonstrating little value with high valuations.

    LLMs will survive, likely improve into coordinator models that request data from SLMs and connect through MCP, but the investment bubble can’t sustain

  • source
  • parent
  • [–] 4 points 1 year ago* (1 child)

    Technologies come and go, but often when a worldwide popular one vanishes, it's because it got replaced with something else.

    So lets say we need LLM's to go away. What should that be? Impossible to answer, I know, but that's what it would take.

    We cant even get rid of Facebook and Twitter.

    BUT that being said. LLMs will be 100x more efficient at some point - like any other new technology. We are just not there yet.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 8 points 1 year ago* (last edited 1 year ago)

    @themurphy @rigatti There is one difference ... LLM's can't be more efficient there is an inherent limitation to the technology.blog.dshr.org/2021/03/internet In 2021 they used 200PB and they for sure didn't make a copy of the complete internet. Now ask yourself if all this information without loosing informations can fit into a 1TB Model ?? ( Sidenote deepseek r1 is 404GB so not even 1TB ) ... local llm's usually < 16GB ... This technology has been and will be never able to 100% replicate the original informations. It has a certain use ( Machine Learning has been used much longer already ) but not what people want it to be (imho).

  • source
  • parent
  • [–] 8 points 1 year ago (4 children)

    Those users are not paying a sustainable price, they're using chatbots because they're kept artificially cheap to increase use rates.

    Force them to pay enough to make these bots profitable and I guarantee they'll stop.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 1 year ago* (3 children)

    Or it will gate keep them from poor people. It will mean alot if the capabilities keep on improving.

    That being said, open source models will be a thing always, and I think with that in mind, it will not go away, unless it's replaced with something better.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 1 year ago (2 children)

    I don't think they can survive if they gatekeep and make it unaffordable to most people. There's just not enough demand or revenue that can be generated from rich people asking for chatGPT to do their homework or pretend to be their friend. They need mass adoption to survive, which is why they're trying to keep it artificially cheap in the first place.

    Why do you think they haven't raised prices yet? They're trying to make everyone use it and become reliant on it.

    And it's not happening. The technology won't "go away" per se, but these these expensive AI companies will fail.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago (1 child)

    Well, if they succeed, it's because of efficiency and lowering costs. Second is how much the data and control is really worth.

    The big companies is not just developing LLM's, so they might justify it with other kinds of AI that actually makes them alot of money, either trough the market or government contracts.

    But who knows. This is a very new technology. If they actually make a functioning personal assitant so good, that it's inconvinient not to have it, it might work.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago

    I can see government contracts making a lot of money regardless of how functional their technology actually is.

    It's more about who you know than what you can actually do when it comes to getting money from the government.

  • source
  • parent
  • [–] 6 points 1 year ago

    And most importantly the Pandora box has been opened for deep perfect scams and illegal usage. Nobody will put it in the box again, because even if everyone agreed to make it illegal everywhere it's already too late.

  • source
  • parent
  • [–] [S] 3 points 1 year ago

    That capital was ash earlier this year. The latest $40 Billion-with-a-B financing round is just a temporary holdover until they can raise more fuel. And they already burned through Microsoft, who apparently got what they wanted and are all “see ya”.

  • source
  • parent
  • [–] 14 points 1 year ago (2 children)

    How the hell are they going to sustain the expense to power that? Setting aside the environmental catastrophe that this kind of "AI" entails, they're just not very profitable.

  • source
  • hideshow 2 child comments
  • [–] 13 points 1 year ago

    Look at all the layoffs they've been able to implement with the mere threat that AI has taken their jobs. It's very profitable, just not in a sustainable way. But sustainability isn't the goal. Feudal state mindset in the populace is.

  • source
  • parent
  • [–] 27 points 1 year ago

    Fucking Doc Brown could power a goddamn time machine with this many jiggawatts, fuck I hate being stuck in this timeline.

  • source
  • [–] 13 points 1 year ago (2 children)
  • [–] 23 points 1 year ago (11 children)

    And an LLM that you could run local on a flash drive will do most of what it can do.

  • source
  • hideshow 11 child comments
  • [–] 10 points 1 year ago (6 children)

    I mean no not at all, but local LLMs are a less energy reckless way to use AI

  • source
  • parent
  • hideshow 6 child comments
  • [–] 1 point 1 year ago* (5 children)

    Why not... for the ignorant such as myself?

  • source
  • parent
  • hideshow 5 child comments
  • [–] 3 points 1 year ago* (4 children)

    AI models require a LOT of VRAM to run. Failing that they need some serious CPU power but it’ll be dog slow.

    A consumer model that is only a small fraction of the capability of the latest ChatGPT model would require at least a $2,000+ graphics card, if not more than one.

    Like I run a local LLM with a etc 5070TI and the best model I can run with that thing is good for like ingesting some text to generate tags and such but not a whole lot else.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 1 year ago* (3 children)

    How slow?

    Loading up a website with flash and GIF in the 90s dialup slow... Or worse?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 1 year ago

    Basicly I can run 9b models on my 16gb gpu mostly fine like getting responses of lets say 10 lines in a few seconds.

    Bigger models if they don't outright crash take for the same task then like 5x or 10x longer so long it isn't even useful anymore

    So very worse.

  • source
  • parent
  • [–] 1 point 1 year ago

    It's horrendously slow, unusable imo. With the larger DeepSeek distilled models I tried that didn't fit into VRAM you could easily wait 5 minutes until it was done writing its essay. Compared to just a few seconds when it does. Bit that's with a RTX 3070 Ti, not something the average ChatGPT user has lying around probably.

  • source
  • parent
  • [–] 1 point 1 year ago*

    Like make a query and then go make yourself a sandwich while it spits out a word every other second slow.

    There are very small models that can run on mid range graphics cards and all, but it’s not something you’d look at and say “Yeah this does most of what chatGPT does”

    I have a model running on a gtx 1660 and I use it with Hoarder to parse articles and create a handful a tags for them and it’s not… great at that.

  • source
  • parent
  • [–] 8 points 1 year ago (9 children)

    that's a lot. remember to add "-noai" to your google searches.

  • source
  • hideshow 9 child comments
  • [–] 2 points 1 year ago* (last edited 1 year ago)

    This is my weekly time to tell lemmings about Kagi, the search engine that does not shove LLM in your face (but still lets you use it when you explicitly want it) and that you pay for with your money, not your data.

  • source
  • parent
  • [–] 0 points 1 year ago (5 children)

    Or just use any other better search like Bing or duckduckgo. googol sucks and was never any good. Quit pushing ignorant garbage.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 8 points 1 year ago
    [–] 8 points 1 year ago

    That's alright. When they've got a generation of people who can't even hold a conversation without it, let alone do a job, that price increase will drop that energy use pretty rapidly.

  • source
  • [–] 7 points 1 year ago (3 children)

    40Wh or 18Wh which is it?

    That's my old gaming PC running a game for 2min42sec-6minutes ... Roughly.

  • source
  • hideshow 3 child comments
  • [–] 7 points 1 year ago

    The last 6 to 12 months of open models has pretty clearly shown you can substantially better results with the same model size or the same results with smaller model size. Eg Llama 3. 1 405B being basically equal to Llama 3.3 70B or R1-0528 being substantially better than R1. The little information available about GPT 5 suggests it uses mixture of experts and dynamic routing to different models, both of which can reduce computation cost dramatically. Additionally, simplifying the model catalogue from 9ish(?) to 3, when combined with their enormous traffic, will mean higher utilization of batch runs. Fuller batches run more efficiently on a per query basis.

    Basically they can't know for sure.

  • source
  • [–] 10 points 1 year ago (2 children)

    Isn't this the back plot of the game, Rain World? With the slug cats and the depressed robots stuck on a decaying world when the sapient, organic species all left?

  • source
  • hideshow 2 child comments
  • [–] 29 points 1 year ago (3 children)

    Bit of a clickbait. We can't really say it without more info.

    But it's important to point out that the lab's test methodology is far from ideal.

    The team measured GPT-5’s power consumption by combining two key factors: how long the model took to respond to a given request, and the estimated average power draw of the hardware running it.

    What we do know is that the price went down. So this could be a strong indication the model is, in fact, more energy efficient. At least a stronger indicator than response time.

  • source
  • hideshow 3 child comments
  • [–] 8 points 1 year ago

    This bubble needs to pop, the sooner the better.

  • source
  • load more comments
    view more: next ›
    8 comments in c/technology@lemmy.ml view that post
    4 comments in c/technology@lemmy.zip view that post