all 66 comments

sorted by: hot top controversial new old
[–] [S] 70 points 21 hours ago (12 children)

AI can write a convincing essay about fire, but it has never burned a finger. Pearl’s point is less that these systems are useless and more that fluency gets mistaken for understanding. Silicon Valley saw a spectacular autocomplete and immediately started selling it as a digital philosopher. The marketing department achieved AGI first.

  • source
  • hideshow 12 child comments
  • [–] 36 points 21 hours ago (9 children)

    Yes, LLMs are incredible tools if used in appropriate situations by people who understand LLMs' limitations. Like any other tool, actually. Give a drill to an idiot and just wait for the disaster.

  • source
  • parent
  • hideshow 9 child comments
  • [–] 24 points 20 hours ago (3 children)

    "A fool with a tool is still a fool" - Grady Booch (father of UML)

  • source
  • parent
  • hideshow 3 child comments
  • [–] 8 points 8 hours ago (3 children)

    In case anyone is interested, here's an article I really like that very well describes how LLMs are not like all other tools, in particular how they're are fundamentally different than tools like a drill, and how this difference is bad actually: https://deadsimpletech.com/blog/no-such-thing-as-just-a-tool

    Not disagreeing that an idiot with a drill is also a disaster, I just think there are some interesting differences worth lingering on too!

  • source
  • parent
  • hideshow 3 child comments
  • [–] 0 points 7 hours ago (1 child)

    very well

    I stopped reading after a few paragraphs. No idea what the author wanted to say. Reference to old philosophers is cool, but first you need to explain WHAT you're trying to say, and only then pour down all that philosopher gibberish onto reader.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 4 hours ago

    I generally think most philosophy is overly academic wank written by people who desperately need to go outside but I also think the author of that article does a very good job laying out exactly what they're trying to say and why it matters. You might actually learn a thing or two if you bothered to read it.

  • source
  • parent
  • [–] 2 points 1 hour ago* (1 child)

    fluency gets mistaken for understanding

    That’s it. I am going to borrow that phrase.

    And a huge component is that Silicon Valley mindset that… values fluency over understanding, I guess?

    The words to describe it are hard. The “Elizabeth Holmes Complex” in You Can See Everything pretty much sums it up.

  • source
  • parent
  • hideshow 1 child comment
  • [–] [S] 2 points 1 hour ago

    Steal it freely. I think the mindset is less about valuing fluency than treating confidence as evidence. Holmes sold a story so convincingly that asking whether the machine worked became almost rude. Now we’re doing it again, except the machine can write its own pitch deck.

  • source
  • parent
  • [–] 18 points 15 hours ago

    Roughly citing Taleb: in a way, we have managed, indeed, to create the utopia that people and computers think alike.

    ...though we didn't manage to bring about that machines think like people, but exactly the opposite.

  • source
  • [–] 12 points 18 hours ago (43 children)

    The quote is from 2018. Back then most neural networks were still mostly single purpose - far from today’s all-in-one package. Text generation was barely working at all.

  • source
  • hideshow 43 child comments
  • [–] 36 points 16 hours ago (41 children)

    The underlying problems are still the same. Transformer models do not have an inkling of intelligence, and they still don't have an internal model of the world around them. Creativity is also non-existent, which is a hard requirement if you want these things to actually create something new instead of rehashing what already exists.

  • source
  • parent
  • hideshow 41 child comments
  • [+] -15 points 15 hours ago* (last edited 15 hours ago) (30 children)

    LLMs have made a number of significant mathematical discoveries in the past year. Some of them were problems that had significant prize money attached and were considered some of the biggest open problems in mathematics. This has been so disruptive that Terrance Tao, who is widely considered to be the worlds greatest living mathematician, has spent considerable time publicly grappling with how the field of mathematics should proceed now that AI is in the picture (for example, he thinks less importance should be placed on discovery, since that is now trivial, and more emphasis should be placed on understanding).

    I am sympathetic to criticisms of LLMs, but these criticisms need to be grounded in reality. We can’t just put our head in the sand. To say that AI has “not an inkling of intelligence” is just factually inaccurate at this point.

  • source
  • parent
  • hideshow 30 child comments
  • [–] 19 points 15 hours ago (27 children)

    And we will never learn how many of these discoveries are born out of simple theft.

    Statistics do not have intelligence.

  • source
  • parent
  • hideshow 27 child comments
  • [+] -13 points 15 hours ago (26 children)

    You do not simply steal groundbreaking mathematical theorems. These are open problems that haven’t been solved, so prior to these AI proofs no solution had been discovered, so there was nothing there to steal.

  • source
  • parent
  • hideshow 26 child comments
  • [–] 13 points 15 hours ago (24 children)

    Dunno about that. Cause they did steal them. Assuming their solutions are even correct, cause nobody has done peer review on them, because LLMs can't publish and anthropic or whoever refuses to engage with the academic community.

    All this and there's a lot of talk about stealing results among maths academics right now. Including a lack of attribution.

    So yeah. They probably did steal that shit

  • source
  • parent
  • hideshow 24 child comments
  • [–] -4 points 15 hours ago* (23 children)

    I doubt they stole the results of quasi Riemann hypothesis, unique games conjecture and exponential time hypothesis.

  • source
  • parent
  • hideshow 23 child comments
  • [–] 11 points 15 hours ago (12 children)

    Doubt all you like. But the idea a company stole something is hardly controversial or unlikely.

  • source
  • parent
  • hideshow 12 child comments
  • [–] 5 points 13 hours ago (7 children)

    Only if that thing exists to steal in the first place. If it was stolen the people working on it would have made a claim, no?

  • source
  • parent
  • hideshow 7 child comments
  • [–] 2 points 8 hours ago (6 children)

    Hard to say exactly. I know my comments have been scraped by ChatGPT and other AI companies. But I don't know how much of what I've said has contributed.

    Also, when they have such funding, they can pay me off more than an award or the fame would be worth.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 1 point 7 hours ago* (5 children)

    The sheer volume of these proofs is enough to suggest that it wasn’t due to theft. Many of these proofs are so significant that any one of them being discovered would have been math news of the decade, but OpenAI published nearly 275ish of them all at once. What are the odds that hundreds of mathematicians just so happened to get their groundbreaking proofs scraped all at once, just before they published them, and none of them have spoken up?

  • source
  • parent
  • hideshow 5 child comments
  • [–] 3 points 6 hours ago (4 children)

    What are the chances?

    I don't know, but neither do you.

    However, it is non-zero

    Because they've already done it.

    https://www.forbes.com/sites/sandycarter/2026/09/10/did-openai-steal-a-1m-math-proof-four-questions-for-every-ceo/

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 3 hours ago* (3 children)

    This is an interesting story but like I said the sheer volume of these proofs is astonishing. If it was just that one particular proof then you’re above link would definitely be reason for skepticism but we’re talking about nearly 300 proofs here, all dumped at once. Many of them have been open problems for decades if not a century plus, and many of them are so significant that even solving one would have been math news of the decade. A scenario where all these breakthroughs just so happen to be made simultaneously, just in time for OpenAI to steal them is just not believable. That many significant breakthroughs coincidentally happening all at once is unprecedented in intellectual history. I understand that people hate AI, but the fact that people are denying that these breakthroughs in AI actually happened just shows that the Lemmy/Piefed users have, in general, a very minimal understanding of the relevant mathematical literature. You guys can downvote me all you want for saying that but that’s the truth.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -1 points 3 hours ago (2 children)

    Many of them have been open problems for decades if not a century plus, and many of them are so significant that even solving one would have been math news of the decade.

    That isn't quite true. Many have been open for a long time. But most have paltry prizes and people just don't have the time or inclination to solve many of them

    Earlier releases of the solutions also were attributed to people who wrote papers, just not in English.

    Even then, solving them isn't really that big a deal. This is an attempt at a PR stunt to try and fix one of the biggest problems with ai.

    That they can't do math.

    You can see extremely famous videos of people asking LLMs how many e's in seventeen and being told it's actually 2 words.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 2 hours ago (1 child)

    This comment is riddled with verifiable, factual inaccuracies and does nothing but demonstrates your own ignorance and misunderstanding. I don’t even know how to engage with someone such as yourself who is not grounded in reality. It is like trying to engage with a climate change denier

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 14 hours ago* (3 children)

    Are you suggesting that these open problems in mathematics were in fact solved by someone who did not take any prize money for them or claim any credit, unbeknownst to the entire mathematical community, and the AI stole these secret solutions? Because in order for these solutions to be stolen that would need to be the scenario.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 13 hours ago (2 children)

    I am suggesting that someone was in the process of finalising publication of papers which might have asserted these. Papers such as these can take more than a year as a draft paper.

    Draft papers are often made public for gasp peer review

    And they robbed that person.

    Yes

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 10 hours ago* (last edited 10 hours ago)

    Can you can give specific details about who specifically was robbed and what draft paper specifically was stolen? (Note the at OpenAI recently dumped nearly 300 new results so we’re talking about a lot of draft papers stolen here.)

  • source
  • parent
  • [–] 2 points 10 hours ago

    Many of which were long standing problems. Not insignificant ones either: many computer science papers are now invalid because they based on the assumption that ETH is true - now proven false!

    It’s highly inconceivable that all these problems had unpublished drafts waiting to be published all at the same time. If only one had been solved by a human it would be the biggest maths news of the decade.

  • source
  • parent
  • [–] 6 points 15 hours ago* (last edited 14 hours ago) (9 children)

    There have been accusations by mathematicians that OpenAI used their (non-public, but fed to OpenAIs LLM) methods. It would have been very possible to take what they already did and throw as much compute as they had available at it as soon as the hard parts were done to race ahead at the final stretch.

    LLMs fail badly at trying to do original research. There was a study where 4 not-yet published papers were used - they gave the LLM all the data the researchers had at the beginning of the study. The LLMs were not successful at reproducing anything of it.

    These things are not intelligent. Just because they can remix existing content does not mean they have creativity. And they miss the entire "physicality"-aspect of human existence, which is a central part of how intelligence develops - by interacting with the world and creating an internal model of how it works. They do not have a sense of self - a bunch of matrix multiplication will never achieve this.

    They can't be creative, because for creativity (and therefor intelligence - these two things go hand in hand) you must be able to have thoughts that have never been thought in a specific context. All these transformer models do is to remix existing thoughts - this looks a bit like intelligence, but the contained data can never be expanded outside of training a new model at a large expense. Intelligence also means to be able to learn and adapt - outside of creating a text file where LLMs can store their non-original output and reading it again, they do not have this capability, especially the "adaptation" part.

    Do not humanize these mathematical constructs. This thinking is what got us into the current mess to begin with.

    I personally like the technology aspect of Transformer Models a lot! But what is done with it is not in the interest of humanity - at all. Just this morning we all were able to read in the news that Anthropic uses its LLM to do a "Minority Report" and contact the police when their LLM, which is being used to scrape socials and categorize people depending on how much "Threat" they pose, tells them someone might do something illegal in the future.

    This is the real usage of this technology. We are nearing a future where our every step, action, word, and even thoughts in some cases (through the wonders of profiling) are ingested by one of these things, and we will get sorted into bins according to threat level and how much money we can provide them with. Tip your toe over the line by saying that this sucks ass, and find yourself in your friendly neighbourhood reeducation gulag.

  • source
  • parent
  • hideshow 9 child comments
  • [–] 6 points 13 hours ago

    If it was only Navier-Stokes I would agree. Now it has produced significant results for hundreds of high profile problems - many of which would be Fields medal worthy if solved by a human. It’s vanishingly unlikely that all of these already had unpublished solutions waiting.

  • source
  • parent
  • [–] 5 points 14 hours ago (7 children)

    I’m not trying to say that LLMs are on the whole good for humanity. I agree with you that they’re not. And I’m not trying to argue that OpenAI never steals intellectual property. Clearly they do.

    But these mathematical problems were solved by OpenAI’s models. That much is indisputable. There was nothing in the training data that could have given them the solutions.

  • source
  • parent
  • hideshow 7 child comments
  • [–] -1 points 14 hours ago* (6 children)

    If you feed them the approach the mathematicians were using, they for sure can solve it! It has never been published what source material their LLM was provided with. This is the equivalent of someone telling you a result, but never telling you how they got the information needed to achieve it in the first place.

    There is value in this technology. But we should do out best to not conflate remixing shit with intelligence - these things are not the same at all. LLMs are more like the proverbial infinite room of monkeys with typewriters, with the very important restriction that these monkeys can never type something that resembles an original thought.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 4 points 12 hours ago* (last edited 12 hours ago) (5 children)

    If you feed them the approach the mathematicians were using, they for sure can solve it!

    The solutions published by openAI contain techniques that have been reviewed by the mathematical community and determined to be novel. Maybe someone had used the technique before, but then wouldn't they have published their solution or spoken up about openAI stealing their preprint?

  • source
  • parent
  • hideshow 5 child comments
  • [–] 0 points 12 hours ago (4 children)
  • [–] 4 points 11 hours ago (3 children)

    Yes, but only for one result out of 275-ish, and as far as I understand it, the AI proof contained a lot more than their existing research. Failing to credit past work is an issue, and could easily be argued as theft, but this isn't good evidence that AI cannot generate proofs that contain more than just stolen material.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 8 hours ago (2 children)

    And is there any evidence that the required information for the other proofs wasn't already available in the training data? As i said, these things remix stuff, they cannot come up with new stuff.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 1 hour ago

    By "required information for the other proofs", what do you mean exactly?

    1. The proof, more or less in the same structure that the AI output, existed in the literature? This would've been published already and would be very easy to prove was stolen from the input corpus. We know this isn't true.

    2. The theorems and techniques used in the generated proof existed, but were not yet assembled into a final proof? Trained mathematicians have looked at the proof and seem to think it contains novel techniques, or at least novel applications of techniques from different areas of math. Even if that weren't true, this would still be novel work; a lot of math breakthroughs are made this way, and it's a nontrivial feat. Although if this was as far as it could go, we would run into limitations at some point.

    3. The starting point of the proof existed, but the entire proof was built from the ground up by AI, using no existing methods or theorems? This would be very impressive, and as noted above the consensus seems to be that it did create some new techniques, but I'm not experienced or knowledgeable enough to verify that claim. Either way it definitely used at least some previous work for nontrivial reasons.

    It looks like it's somewhere between options 2 and 3 in reality; it used a lot of existing techniques and at least invented some new applications of existing techniques if not created new ones entirely (the line can be blurry). This is also what all mathematicians do! Remixing is coming up with new stuff. No thoughts, or generated output from LLMs, exist without prior context.

  • source
  • parent
  • [–] 2 points 7 hours ago

    Here is the evidence: the entire field of mathematics was trying to solve these problems and couldn’t do it for decades.

    If you want to still insist that it’s just “remixing the training data” then fine, but don’t act like that rules out the possibility of intelligence, because by any reasonable standard a system that can discover hundreds of groundbreaking new mathematical proofs is intelligent. Any human that accomplished that would go down in history as one of the most intelligent people to have ever lived.

  • source
  • parent
  • load more comments (-1 replies)
  • [+] -16 points 14 hours ago (9 children)

    Spoken with the confidence of a non user.

  • source
  • parent
  • hideshow 9 child comments
  • [–] 15 points 14 hours ago (4 children)

    I am not a non-user. I run local models, because i am a tech enthusiast, and am watching the space closely. I will never spend a cent or use the offerings of OpenAI and Anthropic tho - i will not finance the people who are providing the tools to bind us all.

  • source
  • parent
  • hideshow 4 child comments
  • [–] -4 points 14 hours ago (3 children)

    Open weight models are not far behind and good enough to get software developers jobless, but there is a huge difference in what you can do with 1M context and 500token/sec or 60k context and 40token/sec.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 10 points 13 hours ago (2 children)

    Sure! End the AI Bubble and i'll go ahead and buy a bunch of H200's.

    But for real, if you structure your tasks well, you can get by for most things with local models, and for a small business in IT, investing in dedicated hardware you own is a smart move. The employer of an acquaintance of mine bought some inference hardware for his 5 engineer business, and they rely mostly on that. Around 80% of all tasks are done by a GLM5.3 model, and while they currently still use Claude for some things, the percentage of external inference has dropped dramatically in the last months, because people have adapted on how to structure tasks for the local model.

    Noone can explain to me how Claude, OpenAI and the NeoClouds plan to become profitable businesses when you can reduce inference costs by 90% by getting your own inference - and it's not even that hard to set up. if you already have IT staff for your inhouse stuff, they will probably manage.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 12 hours ago (1 child)

    Someone will come up with a decent accelerator eventually. Right now we're in the pre-soundblaster days where audio sythesis is being done by the CPU but for neural networks.

    We're repurposing graphics hardware, these are primitive times.

    Also, there, I explained it for you.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 4 points 12 hours ago

    I have to disagree here. We are on the absolute edge of current physics regarding miniaturization - without a massive breakthrough in quantum physics on how we can use subatomic particles for transistors we are nearing the maximum we can shrink these circuits. These are already optimized for exactly this kind of math - a Vera Rubin will never be able to render a game. Also, the mathematical basis (a ton of matrix multiplication) does not give much hope that we can replace all this math with something simpler. Maybe a radical redesign taking a completely different approach can help, but i wouldn't count on that - it would mean reinventing the whole damn thing on a completely new base.

    I can't really see any explanation when i take the above into account.

  • source
  • parent
  • [–] 3 points 4 hours ago

    I use Claude every day for actual production software used in a real product and I can say with confidence that even the most advanced publicly available models totally lack the higher order thinking required to build good software. They're pretty good at writing code, when directed well. They are not good at architectural or design decisions and they're even worse at actually following decisions made outside of their context. Those are the actually challenging parts of software engineering and you have to beat them into the model every step of the way or your software quickly becomes an unmaintainable mess.

  • source
  • parent
  • [–] 1 point 10 minutes ago

    I still can’t believe that his son was the WSJ journalist who was beheaded by ISIS.

  • source
  • [–] -1 points 10 hours ago

    Well duh.

    If it had any intelligence it'd be over. For better or worse.
    It'd be humanity's last invention.

    You wouldn't get news reports that the machine has gotten 30% smarter over the last three months or something.
    It'd be like waiting at a station platform and then getting knocked over by a gust of wind as the train disappears over the other horizon.

  • source
  • [–] -1 points 18 hours ago

    My conclusion is that they're auto-indexing books capable of rapidly temporarily integrating and regurgitating knowledge they store if you inject electricity into them, but still just books in the end after you cut their power.

  • source
  • [–] -5 points 12 hours ago* (3 children)

    Dude is still feeding the grift with this "deep learning" nonsense.

  • source
  • hideshow 3 child comments
  • Deep learning is an actual term, it's not just made up nonsense. It's "deep" because the machine learning is filtered through multiple layers between the data input and algorithm output, versus "shallow" learning, which has only one or two layers between input and output.

  • source
  • parent