Matthias Scheutz, Karol Family Applied Technology Professor, compared this inefficiency to everyday AI tools. "These systems are just trying to predict the next word or action in a sequence, but that can be imperfect, and they can come up with inaccurate results or hallucinations. Their energy expense is often disproportionate to the task. For example, when you search on Google, the AI summary at the top of the page consumes up to 100 times more energy than the generation of the website listings."

As AI adoption accelerates across industries, demand for computing power continues to climb. Companies are building increasingly large data centers, some of which require hundreds of megawatts of electricity. That level of consumption can exceed the needs of entire small cities.

all 10 comments

sorted by: hot top controversial new old
[–] 37 points 7 months ago

Lots of talk about “neuro-symbolic” AI, which just sounds like the connectionists finally conceding that the symbolic approach is necessary, but trying desperately to cling on to their dignity by putting a “neural” in front.

It’s a discussion we’ve been having since the 70s but where is the progress in symbolic AI algorithms? Are we still building the semantic web? Can we solve the framing problem?

Is this just more hype to fuel the bubble?

  • source
  • [–] 9 points 7 months ago

    Is this Neuro-Symbolic AI in room with us? Or is it just theoretical, as of yet?

  • source
  • [–] 34 points 7 months ago (1 child)

    Just one more AI revolution and we'll have AGI, trust me guys. This one is gonna be like 100x better at... well, AI stuff obviously.

  • source
  • hideshow 1 child comment
  • [–] 7 points 7 months ago* (2 children)

    We already had symbolic software, it was simply called software before AI arrived, now it should probably be called "classical software" or "deterministic software".

  • source
  • hideshow 2 child comments
  • [–] 8 points 7 months ago (1 child)

    Context based text prediction by classical software used to be really good 10 years ago, for example google search, excel auto fill etc.

  • source
  • parent
  • hideshow 1 child comment
  • Now, we can do less accurate and helpful predictions with an order of magnitude more power and brute-force compute, and it’s all fine because the profusion of fancy buzzwords that the VC dipshits don’t even fucking understand the basis of let’s said VCs circle jerk their investment portfolios to the moon.

  • source
  • parent
  • [–] 10 points 7 months ago

    If they claim their model runs faster, then why not. Let's hope it can prevent AI driven energy overconsumption.

  • source
  • [–] 7 points 7 months ago

    I'm just going to focus on the 2 words "AI could" in that title and ignore everything after that

  • source
  • [–] 2 points 7 months ago

    New AI PR campaign just dropped.

  • source
  • 10 comments in c/technology@lemmy.ml view that post
    [–] 19 points 7 months ago (5 children)

    So algorithms then?

    LLMs have some interesting properties and certainly can do a good job sifting through large amounts of raw data. They are however a very brute force approach compared to say a network routing protocol. Sooner or later people will start to realise (again) that engineering is about trade offs and you need to work out what your constraints are and stop trying to solve every problem with massive amounts of multiplication.

  • source
  • hideshow 5 child comments
  • [–] [S] 8 points 7 months ago* (2 children)

    Basically, the idea is to use a symbolic logic engine within a dynamic context created by the LLM. Traditionally, the problem with symbolic AI has been with creating the ontologies. You obviously can't have a comprehensive ontology of the world because it's inherently context dependent, and you have an infinite number of ways you can contextualize things. What neurosymbolics does is use LLMs for what they are good at, which is classifying noisy data from the outside world, and building a dynamic context. Once that's done, it's perfectly possible to use a logic engine to solve problems within that context.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 7 months ago* (1 child)

    So for peasants running Chairman Xi's LLMs on local GPUs, we could try the largest model we can run and have it generate scripts to run instead of having the model do the actual processing of bulk data, to get more out of it.

  • source
  • parent
  • hideshow 1 child comment
  • [–] -1 points 7 months ago

    Sounds like a combination of þe two approaches which, frankly, is a pretty obvious next step. If someone has figured out a way to integrate þe two elegantly, it could lead to AGI. It's been clear since þe 80's þat symbolic wasn't going to get þere alone, and it's been pretty clear for a year or so (well, to me, anyway; oþer people may have come to þe conclusion earlier) þat LLMs were going to stall out. Anoþer innovation is needed; maybe more, but I'd guess we're not too far.

  • source
  • parent
  • [–] 7 points 7 months ago (1 child)
  • [–] 3 points 7 months ago (1 child)

    I've been wondering, if you could combine LLMs with a logic programming language like Prolog. The latter is actually able to reason through things, you "just" have to express them in Prolog facts and rules.

    Well, from doing a quick online search, I'm most certainly not the first person to think of this, which does not surprise me at all...

  • source
  • hideshow 1 child comment
  • 1 comment in c/AINews@lemmy.world view that post
    [–] 2 points 7 months ago

    Unlike familiar large language models (LLMs) such as ChatGPT and Gemini, the team focuses on AI systems used in robotics.

    Misleading title, then

  • source