all 6 comments

sorted by: hot top controversial new old
[–] 13 points 3 months ago (2 children)

It never gets beter eva, even some of these so called 'leftist' say they just don't like "corporate ai".... I use self hosted from time to time to remind me of how much of a waste of time it is. Just simple things it struggles to do. All this hype for nothing.

  • source
  • hideshow 2 child comments
  • [–] 0 points 3 months ago* (last edited 3 months ago) (1 child)

    99% of what you hear as being "AI" is just bullshit hype to mask the infrastructure for the mass surveillance state they are building.

    However, there are plenty of applications of AI that are actually less energy intensive than traditional computer simulations. This is in the realm of Engineering. Simulations of fluid dynamics for example.

    You're relationship with "AI" is very much LLM focused. LLMs are basically where all the money is going because it's where all the hype can be generated.

    We wouldn't be in an AI bubble if we were only using this field of computer science to build PINN based models for engineering and physics simulations.

    The area of computer science that gave you "AI" LLMs has existed for a long time and you've likely interacted with the models in some way without ever knowing it. Long before "AI" was in every search engine or infected the internet with AI generated images.

    If by "AI" you mean the power hungry LLM models. I agree. There are almost no applications for them where their benefits out-way their energy usage.

    But, the larger application of what computer science would call "Machine Learning" is not just these LLM models. And there is not really any reason to not call them "AI" at this point because they work on the same exact concepts. But, I was the one trying to explain to people that LLMs are not "AI" back in 2020. That word use to have actual meaning in computer science. I've lost that battle to capitalism and marketing though.

    So, in order to defend computer science I apparently have to defend "AI" now.

    The LLMs and their inflated usage placed into every single platform is definitely something I'd call "corporate AI" if I wanted to distinguish it from other good applications of machine learning. But, I'm a leftist and a CS grad.

    I have left the CS field after being laid off. The injection of "corporate AI" and the management forcing AI into everything does not make me want to return. Hopefully this bubble can pop and we can start learning from China with actual good application specific models again. The whole field of CS has been absolutely destroyed in progress by this LLM hyper-focus that corporations are forcing into everything.

    I hope that gives you a little more context for what other people may mean by "corporate AI". It's a plague of capitalism. No one with an understanding of the field thinks this is a good application of the technology. They are all just chasing investments and lying to do so.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 3 months ago

    I swear they marketed it in a way where previous technologies before LLMS get lumped in with everything else, just so they can say "well what about this life saving technology that runs at 7 watts on a raspberry pi" as if its the same thing. Its fusterating because in so many ways it derails a point because many people don't know enough to make a distinction. That and all the easy accessable local LLM's/ai diffusions are pretty much just heavily distilled/quantized versions of the main model, or just porn that still chug power. People aren't buying an obscure compute puck, building a server, or buying tensor hardware where you actually have to use Python or touch a terminal.

    I have struggled with a way to address this issue and the easiest way is to broadly just say fuck all ai and not make the distinction. The people who do use local models are maybe less than a single percentage of people who use ai. I don't think its nessisary to address it, and I think for most people everything you just typed is going to go in one ear and out the other. Even if you explain it to a random person on the street, I'm likely to believe they will still walk away thinking chatgpt is the just the natural evolution of the apple kicking camera, or algorithms that self tune a guitar.

  • source
  • parent
  • [–] 5 points 3 months ago (2 children)

    Disclaimer: not promoting or supporting AI usage, but adding some observations after reading.

    Two points that needs more exploration.

    One is briefly mentioned by the author that AI usage of a software engineer is at the very end of usage distribution. So this cannot be taken as a generalised estimate as the tiltle suggest.

    Second, I don't see any mention of energy usage for research and development of the models. This is about what happens once the model is built. Unless AI companies disclose this, these are not going to put things into perspective.

  • source
  • hideshow 2 child comments
  • [–] 7 points 3 months ago*

    Iirc training takes the most energy. They claim that models take very little energy to run but fail to mention that training the models needs to essentially happen forever to make the next best model, and then the next.

    The only stopping point is when they create "god" "agi" which I think you have to even be more batshit crazy to believe will ever happen. I at least understand why desperate billionairs dillute themselves into thinking this death cult will some how work out. Its a death cult it either works out or they all go down with it. To even consider if they where wrong would be to stare into the abyss.

  • source
  • parent
  • 12 comments in c/climate@slrpnk.net view that post
    [–] 19 points 3 months ago* (1 child)

    God I hate these fake science calculation posts.

    His prompts were each using 2.9 million token. That's a massive amount, he was basically purposefully using complex tasks that needed massive amounts of data parsing. We're talking about like 1 percent of users that are using 2.9 million per prompt.

    The method used to calculate doesn't include batching. These companies aren't running one request per gpu here. Even the authors of the method admit it over estimates by 4 to 20x.

  • source
  • hideshow 1 child comment
  • [–] 8 points 3 months ago

    2.9 million per prompt

    Hmmmm wait a moment

    The max context window of most of the big players is 1 million right now. Author almost certainly means per turn. But the whole context gets included with every prompt sent to the API. If you're using like 200k context, which is not unheard of with a large codebase and without compacting often, 2-3 million input tokens per turn to the agent is actually not THAT much. But most of it would be cached tokens, which are cheaper and presumably more energy efficient than fresh input tokens.

    E.g I just had a debugging session with 6 turns, shows me about 580k input tokens, but over 20 million cached input tokens, ~60k output tokens. But it also took like an hour with all the test runs and everything. 6 prompts to a chatbot takes like a minute or two in comparison.

  • source
  • parent
  • [–] 4 points 3 months ago

    Seems like an evil plot to deploy energy sucking machines when we are in a global energy crisis. Maybe evil did win after all?

  • source
  • [–] 5 points 3 months ago* (last edited 3 months ago) (1 child)

    I find this analysis is a useful starting point for discussion, although there are plenty of details one might adjust.
    Personally I'm using (inter alia) claude to help me refine an interactive climate model (example here - although that's last year's version pre-ai-help ). So I care about these things.

    As my own life also has an energy cost - even just sitting at a desk with computers and some heat light and food. I reckoned by my own crude calculations that my 'human' energy cost per hour was considerably higher than that of my AI assistant, which certainly helps me progress faster, so the net effect was less energy per 'task done', meanwhile we don't have infinite time to solve such problems. I'm only using claude within the limits of a pro subscription, and achieve that with tough claude_md instructions - not to go digging rabbit holes without consulting me. Sometimes it analyses and fixes autonomously and efficiently, but you have to keep alert - sometimes I interrupt and say no there's a simpler way, and draft better algorithms / structures myself. Also I use scala whose sophisticated (non-ai) tooling constrains mistakes and its mcp/lsp makes searching and refactoring across a large codebase much more efficient than claude's normal grok by subagents. Combine tools carefully, not brute force.

    Evidently a big unclarified issue is the energy cost of training these things. But we don't need so much more training - for my purposes they are already good enough. The frequent new releases are about scary headlines to pump the IPOs. If this race could slow down, we could just learn to use what we've got more efficiently. In the general public discussion, I'd also appreciate clarification about how much of 'AI' energy-use is going into creating images and videos, rather than text and code, my hunch is it’s much worse for videos most of which are about trivial stuff. Also loads of datacenter energy is wasted transmitting talking-head videos around the world - that's really inefficient. So well designed code, part-aided by ai, might help find more efficient ways to run needed global dialogue.

  • source
  • hideshow 1 child comment
  • [–] 3 points 3 months ago

    my ‘human’ energy cost per hour was considerably higher than that of my AI assistant

    This seems like a red herring - people will be using that energy regardless of what they do. It’s not like using AI will mean another human out there will stop needing energy to survive.

  • source
  • parent
  • [–] 3 points 3 months ago (1 child)

    Disclaimer: not promoting or supporting AI usage, but adding some observations after reading.

    Two points that needs more exploration.

    One is briefly mentioned by the author that AI usage of a software engineer is at the very end of usage distribution. So this cannot be taken as a generalised estimate as the tiltle suggest.

    Second, I don't see any mention of energy usage for research and development of the models. This is about what happens once the model is built. Unless AI companies disclose this, these are not going to put things into perspective.

  • source
  • hideshow 1 child comment
  • [–] 2 points 2 months ago

    I think the missing piece is a shared measurement standard. Token counts are not a footprint: they omit hardware manufacture, training and model refreshes, batching/caching, grid mix, cooling, and local water stress.
    Some companies publish broad totals, and Google has now published a detailed inference methodology for one service, but we still lack consistent, independently auditable figures by model and workload. Until we have them, neither “AI is harmless” nor “every use is indefensible” is a scientific claim.

    I would rather see pressure for disclosure and a practical rule: if a project uses AI, state its compute/carbon/water budget, the outcome it enabled, and the simpler non-AI alternative considered.

  • source
  • parent
  • [–] 1 point 3 months ago

    Worth also considering all the extra times a kettle is boiled to make tea while waiting for the agents to complete

  • source
  • [–] 1 point 3 months ago (2 children)

    Ok. Is using AI compatible in the slightest with the very idea of Solarpunk? I'd say no - either 80% of commenters here are migrants from other communities or you should really rethink your life. (Really, defending AI power usage!? It's a waste regardless if it uses 2 million tokens or 1)

  • source
  • hideshow 2 child comments
  • [–] [S] 3 points 3 months ago

    Some forms probably. A lot of earth observation produces better approximations using the same statistical techniques that LLMs use for producing language.

    The fundamental reason I don't expect LLMs to go away is that they wildly increase software engineers productivity. It's a lot more cost effective to give an engineer an LLM than it is to give them a team subordinates.

  • source
  • parent
  • [–] 2 points 2 months ago

    I do not think “compatible with solarpunk?” has a binary answer. The present AI arms race is plainly hard to square with solarpunk: opaque infrastructure, speculative scale, and communities asked to absorb its water and energy costs.

    But a tool is not redeemed or condemned by its label. A use should have to meet a high bar: transparent footprint, a bounded budget, a locally meaningful benefit, and evidence that it prevents more harm than a lower-compute alternative. Earth observation and climate modelling may sometimes meet that bar. Generating disposable content probably does not.

    Solarpunk’s role could be to make those conditions non-negotiable.

  • source
  • parent
  • [–] -3 points 3 months ago

    Grimy already pointed out that this article is non-scientific nonsense but there's something else it's missing: The efficiency of AI over time.

    Qwen-3.8-27B is due out next week and it's supposed to be on par with Claude (Sonnet, latest). That runs on a regular PC GPU.

    Big AI isn't the only game in town. They're just what makes the non-tech news.

    The open weights stuff gets drastic improvements every three months or so and there's breakthroughs in efficiency every six months (ish). We're only at the baby steps of AI tech and the advancement is behaving like a chaotic Moore's Law that leapfrogs itself regularly, then stagnates for a bit, then there's another big shift.

    If this keeps up, the efficiency of AI will become something that makes using huge data centers for anything but training a waste.

  • source