you are viewing a single comment's thread
view the rest of the comments
[–] 16 points 1 year ago (13 children)

Datacenter != AI

If you are using the internet for anything with cloud storage, you are contributing to datacenter growth. And that includes nearly everyone using social media.

  • source
  • hideshow 13 child comments
  • [–] 16 points 1 year ago* (4 children)

    Yes but data center growth prior to AI was manageable. There isn't a grid on the planet (except maybe china?) which can support the growth of AI data centers.

    These people have to plan energy needs on a 10-20 year life cycle, not 2. It's the 2 that's the problem.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 1 year ago (1 child)

    The bitcoin miners have hopefully dropped off because they were chewing up gobs of energy too.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago*

    I thought they were totally just using flare gas and renewables ;) 🙄

    But my understanding for real is that ai data centers are just the same hardware as buttcoin but more of it and organized. The venture capitalists finally got what they wanted, blowing their wad on Nvidia.

  • source
  • parent
  • [–] 22 points 1 year ago* (5 children)

    Datacenter != AI

    Except the demand for new data centers is driven entirely by the capacity constraints of the current AI models.

    If you are using the internet for anything with cloud storage, you are contributing to datacenter growth.

    "Why are you mad at my five ton diseal SUV when you just adopted a pet chihuahua? They both emit carbon!"

  • source
  • parent
  • hideshow 5 child comments
  • [–] -5 points 1 year ago (4 children)

    I'm not sure that's true. Every company uses storage, and every growing company needs more. But very few companies are training generative AIs.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 6 points 1 year ago (3 children)

    Every company uses storage, and every growing company needs more.

    You're comparing mountains to molehills. That's before you consider improvements in storage and compression relative to demands for space, or the degree to which our storage capacity "needs" are predicated on the voracious appetite of AI models and their unwanted output. Or, for that matter, the inefficient distribution of data and proliferation of spam data that predates it.

    very few companies are training generative AIs

    Most US Growth Now Rides on AI—And Economists Suspect a Bubble

    The expansion in demand is entirely being driven by the expansion in AI capacity.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -2 points 1 year ago* (2 children)

    That article doesn't say what you imply it does. Companies may be using ChatGPT to grow, but that doesn't mean they are training AIs.

    And the distinction is critical to energy usage. Training a new AI uses a lot of energy. Querying an existing AI uses far less.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 4 points 1 year ago* (1 child)

    Companies may be using ChatGPT to grow, but that doesn’t mean they are training AIs.

    It's the MAG7 that's driving growth. And they're all fixated on training AI in some capacity

    Training a new AI uses a lot of energy. Querying an existing AI uses far less.

    It costs $5 for each 10s video generation, based on Azure's published rates for the first Sora model.

    That's presumably a lot of energy.

  • source
  • parent
  • hideshow 1 child comment
  • [–] -2 points 1 year ago

    The MAG7 operate large and growing cloud services, so their datacenter costs would grow even without any AI training.

    And charging $5 for a video query does not mean the query uses $5 of energy. The query is priced to recoup training costs that were already incurred.

  • source
  • parent