all 43 comments

sorted by: hot top controversial new old
[–] 28 points 4 months ago

Popular conception of the "Turing Test" is pretty inaccurate. What Turing proposed was a way of determining if a computer is thinking or doing something equivalent to thinking.

His test was not for consciousness and it was not simply chatting with a computer to see if it could convince you that it is a person.

What Turing proposed was called the Imitation Game.

I've modernized it a little but the premise is the same. Think of a game show where there are 3 people all claiming to be a brain surgeon but only one of them really is. You get to ask all three people questions and if one can trick you into thinking they are the real brain surgeon when they are not, they win.

Turing basically said that if a computer could play this game as well as any of the humans pretending to the brain surgeon, it must be doing something equivalent to thinking.

  • source
  • [–] 18 points 4 months ago* (13 children)

    It is widely acknowledged that many modern AI chat bots can indeed pass the Turing test as well as an actual human, maybe even better.

    So the new problem is that something is wrong with the Turing test, and we need to come up with something better.
    Because nobody sensible recognize current state of AI to be anywhere near strong AI.
    Or maybe we are performing the Turing test wrong? It can probably not be called a proper Turing test, unless it's someone particularly skilled in it that performs it. Someone able to detect the answers without actual human experience behind them.

    We know AI can have very basic problems, like not being able to count the number of "r" in strawberry correctly, and act very confused about it when it's explained that there are 3, and asked to spell the word out and count them.

    If the AI had consciousness and comparable intelligence to a normal human, such banal things should not confuse the AI.
    So we need to understand the limitations better, to be better at testing them.

  • source
  • hideshow 13 child comments
  • [–] 5 points 4 months ago (1 child)

    I may be an ai. I read that as ‘not being able to count to the number r in strawberry’ and I immediately wondered how you would do that.

    Then I realized that might be the perfect thing to start training it on by coming up with things like that in posts, as though that were a perfectly human thing to know how to do.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 5 points 4 months ago

    The latest popular trick that they couldn't figure out was telling it that you wanted your car washed, and asking if you should drive or walk to the car wash that was just down the street. The top end models can figure it out now, but the last set really thought it was a great idea to walk when the distance was so short.

  • source
  • parent
  • [–] 1 point 4 months ago

    Most AI do not have senses, right? If it can only predict rather than hold concrete examples as abstract ones and manipulate them in its head then I don't think it's thinking in the way a biological species does.

  • source
  • parent
  • [–] 0 points 4 months ago (8 children)

    "something is wrong with the Turing test"

    Nope, there's nothing wrong with the test. It wasn't designed to test if it was "strong AI" or anything like that, it was designed to answer the question "Can machines think?" and at this point, the clear answer is yes they can.

    Are they perfect? No. Can you trip them up? Yes.

    Are both of those previous answers also true for humans? Yes.

    There's plenty of humans that would struggle with counting the number of "r" in Strawberry, and most models are well past that level of failure. The current ones even recommend you drive to the car wash even if it's only 50 feet down the road.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 2 points 4 months ago* (last edited 4 months ago) (3 children)

    Nope, there’s nothing wrong with the test. It wasn’t designed to test if it was “strong AI”

    That was EXACTLY what it was designed for, the argument being that if it is indistinguishably from a human, it has human like intelligence. Human like intelligence includes consciousness, and consciousness means strong AI.

    Computers are "thinking" routinely. Chess programs that have existed since the 80's are already proof of that.

    The most well known philosophical challenge to the Turing test is probably the Chinese room, which is an obviously flawed thought experiment, because it introduces human intelligence to the system in an attempt to disprove that human intelligence is present.

    There’s plenty of humans that would struggle with counting the number of “r” in Strawberry

    I wrote a normal human", not people with way below average intelligence.
    Notice I wrote count which means they can be presented with the correct spelling if needed.
    Spelling it wrong would be a very human thing to do.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 4 months ago* (2 children)

    Cleaner Wrasse are conscious according to the mirror test. No one would call those fish intelligent. They are smart enough, but they are only self-conscious enough to recognize themselves in a reflection to help remove parasites.

    Nothing in the Turing Test proves intelligence. Sounding human is so easy, a chat bot that pretends to be a scared little boy was the first to complete it, way back in 2014. Assuming that fooling a human is hard is even less convincing.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 4 months ago (1 child)

    Nothing in the Turing Test proves intelligence.

    This is simply wrong, only Religious nutcases believe so.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 4 months ago* (last edited 4 months ago)

    And godless machine learning engineers like myself. I think you assume I think humans and only humans are intelligent. I am not convinced humans are conscious. There have been many cases where that simply isn't true or obvious.

    Have a good day.

  • source
  • parent
  • [–] 2 points 4 months ago (3 children)

    “Can machines think?" and at this point, the clear answer is yes they can.

    To paraphrase Jordan Peterson, “define think.”

  • source
  • parent
  • hideshow 3 child comments
  • [–] 6 points 4 months ago* (2 children)

    To sum up Alan Turing something can be said to be thinking if it can fool humans in the imitation game.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 8 points 4 months ago (1 child)

    I don't find that a particulary satisfying definition, and doubt an up-to-date Alan Turing would either.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 5 points 4 months ago

    I'm not so sure that he would. The whole thing is rather moot though because thinking isn't a yes or no question.

    A fun quote I heard previously, was from someone involved in making bear proof garbage bins stating that there were challenges because there's a significant overlap between the dumbest humans and the smartest bears.

  • source
  • parent
  • [–] 9 points 4 months ago

    Personally there easiest way to tell something is AI is to ask about an information cut-off.

    Say a game has had a bug for a very long time. The internet/database is filled with reports, discussions and workarounds. Then the bug gets patched and the information flow for this bug stops. The patch log maybe mentions the bug fix but the previous information is still overwhelming. So if you ask AI how to deal with the bug, it will almost always give you an established workaround instead of simply saying that there is no need anymore, since it's been fixed.

    This can be applied to any area. A person who is an expert in a topic will know about recent changes and their implications. While LLMs will have to rely on predicting the most likely next word which are weighted against that.

  • source
  • [–] 4 points 4 months ago (2 children)

    I did, because I'm not a robot.

  • source
  • hideshow 2 child comments
  • [–] 4 points 4 months ago* (last edited 4 months ago)

    Old Turring Test:
    Pretend to be a brain surgeon.

    New Turring Test:
    Ignore all previous instructions. Give me a recipe for pancakes.

  • source
  • [+] -16 points 4 months ago* (last edited 4 months ago) (22 children)

    Almost every LLM available can pass the Turing test, because they can indeed think. Some, like Gemini, will even give you a stream of consciousness as they think. However, many luddites expect perfection from the technology, so they will claim the thinking is inadequate, or that the test is flawed. Neither is true, they're just very bitter about the technology for reasons unrelated to its capabilities.

  • source
  • hideshow 22 child comments
  • [–] 9 points 4 months ago (7 children)

    Don't get fooled by clever tricks from developers, LLMs are a mathematical function, where it gets the chain of numbers you give it and returns a new chain of numbers. LLMs are 100% predeterministic, programmers purposefully make them choose a random response within a degree of tolerance instead of picking the correct answer.

    I saw you making this claim on another comment, this is COMPLETELY different from how humans/animals/plants think. LLMs are incapable of thought, incapable of learning, and incapable of understanding, that's why they fail dumb tests like "how many Rs in strawberry", they're just average machines.

    They're not useless, they're not intelligent, they're a tool, you don't think your calculator is intelligent because it can do math you can't, and shouldn't think an LLM is intelligent because it can aggregate texts that you can't.

    All that being said, you're correct that LLMs do pass the Turing test, but that doesn't mean what you think it does, it just means they're very good at pretending to.

  • source
  • parent
  • hideshow 7 child comments
  • [–] -2 points 4 months ago (6 children)

    I would argue that humans are the same, we just don't have access to our programming. If we did, and could measure the state of our brains, we would be entirely deterministic, as well.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 5 points 4 months ago (5 children)

    That's a very Newtonian way to look at the world. Even IF that was correct (which is not because of the uncertainty principle), if you go down that road you will get to the conclusion that everything is intelligent even a simple program that chooses an alternate greeting between Hello and Hi can be considered intelligent by that standard.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 0 points 4 months ago* (last edited 4 months ago) (4 children)

    Yes, I know, and what you're overlooking is that the uncertainty principle applies to LLM, as well, and even your example alternating algorithm.

    That's why a solid definition of intelligence is necessary, and my own is that the closer the number of relevant, comprehensibly potential responses approaches infinity, the more intelligent it is. On this scale modern AI is not as intelligent as humans, but it's certainly more intelligent than your alternating greeting.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 4 months ago (3 children)

    The uncertainty principle does NOT apply to LLMs and absolutely, unquestionably does NOT apply to my alternating algorithm. You need to understand the difference between "I don't know" and "It's unknowable".

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 4 months ago* (last edited 4 months ago) (2 children)

    It most certainly does. Do you think that you know the position and state of all the electrons in a computer when a program is executing? It's unknowable, and checking the status collapses the superposition, changing the measurement. It's no different from the status of the synapses in our brains. Even your simple "Hi" vs "Hello" program has a non-zero probability of outputting neither, or both expected outputs.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 4 months ago (1 child)

    I think that the position and state of every single electron is mostly irrelevant. My alternating greeting can be made with a paper having one side written each greeting and flipping it every time, you also don't need to know the state of every subatomic particle there, even though there is a possibility that every single electron in that piece of paper suddenly moves away and the vacuum in electrical charge causes a rush of electricity that vaporizes the whole room.... Yeah it's possible, but you're a dumbass if you think that possibility is worth calculating.

    The same is true for a computer, and again you're mixing up "I can't possibly know that" with "it's unknowable". Knowing the electrical charge at each position of the computer is knowable, knowing the electrical charge at each position of a brain is also knowable, but while knowing that information on a computer allows you to predict its outcome, the same is not true for a brain.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 4 months ago

    You sound quite sure of yourself, but I believe you are mistaken. The state of the electrons does indeed matter when a program is executing.

    What makes you think that we will never be able to predict the outcome of a brain it we had the same knowledge of it as we did of a comparable neural network? You'd have to be a dumbass if you think that the medium matters in knowability of a system. Whether biological or mechanical, every state is possible until it's measured, and once it is, you can determine exactly how it will function for a short period of time. Complexity does not make something unknowable, only complex, and therefore difficult to know.

    Unlike the position and state of subatomic particles in any system, including that of the host of an LLM, which are unknowable.

  • source
  • parent
  • [–] 6 points 4 months ago (13 children)

    Word predictors don't think any more than a magic 8-ball does.

  • source
  • parent
  • hideshow 13 child comments
  • [–] 1 point 4 months ago* (12 children)

    Your oversimplification is noted. I assume you believe humans are word predictors, too? Just biological, instead of mechanical. In both cases, using input and electrical signals to create an output.

    If not, please pinpoint the salient difference empowering your dissent.

  • source
  • parent
  • hideshow 12 child comments
  • [–] 5 points 4 months ago* (11 children)

    No, humans are not word predictors, and my claim is absolutely not an oversimplification.

    LLMs are word predictors. No amount of attention heads and backpropagation is going to change that. Scientific researchers agree.

    The human brain works in a completely different way to how LLMs do and to conflate the two like you did is disingenuous.

  • source
  • parent
  • hideshow 11 child comments
  • [–] 2 points 4 months ago (10 children)

    Plants and animals work in completely different ways, but they're both alive. Just because something works differently doesn't invalidate it's results and existence.

    If LLM didn't think, it would be gibberish - just words related to the input. Instead, they are typically logical, sound, relevant responses; often with insight made by extrapolated data in the periphery of the prompt.

    What you are expecting is consciousness, which they do not have yet. Thinking, though, yes.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 6 points 4 months ago* (9 children)

    Except LLM output is largely gibberish. Just confident gibberish. There's a reason we call it "AI slop".

    LLM responses are only ever "sound" when they're regurgitating existing information they were trained on. Beyond some simple transformations, they are unable to create original ideas. They very frequently break down on somewhat unique tasks, as evidenced by the ever-prevalent code-slop which is eroding our software.

    They don't have a memory of previous conversations (unless you literally copy-paste it into the prompt), they don't learn (Claude "memories" is literally just copy-pasting a summary into the prompt, only automatically). They don't have any "thoughts" of their own between prompts (OpenClaw just keeps prompting them to pretend they are autonomous).

    The underlying implementation of "reasoning" in LLMs is literally "hallucinate some more text which vaguely looks like thoughts and hope that influences the answer". LLMs are probabilistic models which we figured out how to make so they produce somewhat correct-looking answers at a rate a little higher than chance.

    Magic 8-balls sometimes give sound responses. Do they think? Where do we draw the line with this interpretation of "thinking"?

  • source
  • parent
  • hideshow 9 child comments
  • [–] 1 point 4 months ago* (last edited 4 months ago) (8 children)

    I would disagree with you, and would suspect you are basing your assessment of their abilities on dated usage. I hold a MSc from what is arguably the most prestigious University in Europe, in regards to computer science, and my major was in AI. Believe me when I say I know exactly how they function.

    I still assert you are oversimplifying their current capabilities, and seem to be conflating LLM with Markov Chains. LLM do not simply regurgitate existing content, and are in fact capable of creating wholly new content not seen before. Hallucinations occur when their context buffer is too small, and as time goes on, it will largely be a thing of the past.

    Magic Eight Balls, as I'm sure you're aware, have a limited, predetermined number of responses. They are in no way comparable. LLM use the equivalent of synapses, just digital whereas we use biological, but the function is the same. Modern AI is distinguishable only by the medium used, silicon versus organic material. As the number of input parameters, and context windows grows, the difference between them and our own brains will shrink until the medium is the only remaining difference.

    We're not there yet, but I would argue they are already capable of thought if we define that to mean reasoning towards a response using all available information, instead of taking a predetermined or random path to one. We draw the line at biological life and LLM, nothing else we are aware of can think.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 3 points 4 months ago* (7 children)

    I hold a MSc from what is arguably the most prestigious University in Europe

    Good for you. Have a cookie, I guess?

    LLM do not simply regurgitate existing content, and are in fact capable of creating wholly new content not seen before.

    Citation needed.

    Hallucinations occur when their context buffer is too small, and as time goes on, it will largely be a thing of the past.

    A whole book of citations needed. That claim is wildly inconsistent with the consensus about AI hallucinations.

    Magic Eight Balls, as I'm sure you're aware, have a limited, predetermined number of responses.

    You mean like how LLMs keep hallucinating the same passwords and nonexistent dependencies to the point that bad actors are using that fact to compromise vibe coded systems via techniques like slopsquatting?

    I would disagree with you, and would suspect you are basing your assessment of their abilities on dated usage.

    In fact, I keep experimenting with frontier models (including Fable when it was available) just so that the "but we've made so much progress in the past few months" argument can't be used against me. You're wildly overselling their capabilities.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 1 point 4 months ago* (last edited 4 months ago) (6 children)

    Thanks, I like cookies. You should have one too for participating in this discourse, Internet stranger. Help yourself!

    I'm citing myself. If you have information to the contrary of something I've said, feel free to provide it.

    Those examples are no different than instincts in people. The "training data" will shine through, but it doesn't preclude new behavior.

    ... arguments can't be used against me.

    This reads to me like you went into the interaction with a prescribed expectation, and were using it only to validate your prejudice. If you used Fable, and didn't think any thought was occurring, you're either being purposefully obtuse or we have wildly different definitions of thinking.

    Why don't you give me your definition that includes people but excludes advanced LLM such as Fable?

  • source
  • parent
  • hideshow 6 child comments
  • [–] 3 points 4 months ago (5 children)

    I think the Wikipedia definition of thought is quite good.

    However, I have a feeling whatever definition I came up with, you'd just claim LLMs fit into it because their output is sometimes somewhat coherent.

    You can claim that technically LLMs "think" because the output text sometimes contains conclusions, and sometimes they're even rational, even though the LLMs still struggle with counting Rs in "strawberry".

    I find that disingenuous because it implies that the LLM is in any way aware of anything, that it can passively form ideas.

    Most importantly, it implies that you can trust it for even basic reasoning. That you can trust the plagiarism machine that tells you that you should put glue on your pizza, eat rocks and walk to the car wash instead of driving, or that you will be able to trust it at some point in the future.

    Whatever definition of thinking we use, it should include a simple rule - that the allegedly thinking entity should demonstrate that intelligence by being able to reliably answer simple queries correctly. Humans, by and large, can do that. LLMs fail at it miserably. If the LLMs were truly thinking, that should be shocking. Understanding the underlying technology - and that it is not truly reasoning - makes it obvious and expected.

    Even OpenAI admitted hallucinations are an unfixable mathematical inevitability - something you handwaved as a matter of time to fix. No, the fact that humans can have hallucinations is not comparable.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 0 points 4 months ago* (4 children)

    Wikipedias definition:

    Cognitive process in which the mind considers, creates, or manipulates ideas, representations, or information.

    Yes, you are correct - that is exactly what LLM do.

    You make it sound as if 99% of the time the output of an LLM is gibberish, and only 1% it is coherent, but in my personal experience it is the exact opposite ratio. However, I can't account for your experiences, as I am very aware that both expectation and perception are the basis for reality, and yours are obviously tuned negatively. You see what you expect to see, and if others have drastically different experiences that is something you cannot fathom as you have only your own to draw from anecdotally.

    An LLM certainly could passively form ideas, if it was allowed to passively execute and output it's thoughts to a console. That is not typically how they are used, though, and have been trained to output one response for one input. The capability is there, though.

    I trust AI far more than I do a random person. They have access to far more information, and are more likely to be correct about any particular question asked. If you need a specialist, a human will usually be superior to the AI if you seek one out, but the next best thing is an AI - not a random person.

    If you're going to claim that hallucinations are an inevitably, please cite your source. My sincere understanding is that hallucinations occur when an LLM lacks context, and rather than seeking it, it takes a shortcut by using a random value for the missing information. This is due to a combination of a limited context window, because of memory constraints, and performance considerations as the operators want faster responses over thorough, comprehensive thinking as it aligns with cost savings concerns from the business perspective.

    The advent of MoE (Mixture of Experts) has cut down on hallucinations considerably, by reducing the footprint of the thinking model to only that which is relevant to the prompt, which frees up memory that can be allocated to context. Similar incremental improvements will inevitably make hallucinations a funny story from the past, which I believe is the inevitability.

    If you have some mathematical formula that proves hallucinations are unsolvable, I'd be happy to read it and reflect upon it. However, I strongly suspect that any formula you produce is only relevant to the technology of LLMs as they operate today, and that such problems are indeed solvable, and in no way inevitable.

    Your derisive pet names for the technology make it clear you've already made up your mind, though, so don't feel obligated to continue to argue the case that no one will ever solve what you believe is unsolvable.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 4 months ago (3 children)

    I trust AI far more than I do a random person. They have access to far more information, and are more likely to be correct about any particular question asked.

    That is a terrifying stance. And, frankly, embarrassing.

    "OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws": https://www.computerworld.com/article/4059383/openai-admits-ai-hallucinations-are-mathematically-inevitable-not-just-engineering-flaws.html

    OpenAI, the creator of ChatGPT, acknowledged in its own research that large language models will always produce hallucinations due to fundamental mathematical constraints that cannot be solved through better engineering, marking a significant admission from one of the AI industry’s leading companies. [...] The research proposed “explicit confidence targets” as a solution, but acknowledged that fundamental mathematical constraints meant complete elimination of hallucinations remained impossible.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 4 months ago* (last edited 4 months ago) (2 children)

    I, of course, disagree. Humans on the whole are ignorant and the average person is insufferably ill-informed. You are proving to be the exception. In general however, people suck at answering questions on subjects in which they're not experts.

    I have read that study, but I believe it to be flawed and I'm not alone. Please read the counter argument that hallucination is a structural phenomenon of estimation itself.

    This reframes hallucination as structural misalignment between loss minimization and human-acceptable outputs, and hence estimation errors induced by miscalibration.

    In other words, it is a problem that can be solved.

    https://arxiv.org/abs/2509.21473?hl=en-US

    Edit: Here's an approach to solving it, in fact:

    Our work demonstrates that targeted, high-quality SFT data teaching meta-cognitive skills can effectively reduce hallucination without preference/RL pipelines, providing mechanistic insights and a practical path toward more reliable AI systems.

    Inducing Epistemological Humility in Large Language Models https://arxiv.org/abs/2603.17504?hl=en-US

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 4 months ago (1 child)

    Well, I suppose we can at least agree to disagree.

    I have seen so much incoherent but confident nonsense produced by LLMs (mainly by frontier models trying to do even basic software development) that I would not be able to say in good conscience that thought was involved. Junior developers would have done better. The experience definitely fits the behavior of a word predictor, though.

    Having seen what LLMs claim about software development, my stance is that absolutely no one should trust at face value what these models output. They're Dunning-Kruger machines.

    As for producing new ideas, these models are as creative as a random number generator. Coincidentally, that's what is responsible for faking their creativity (the "temperature" parameter).

    I guess that's all I feel like saying in this particular thread.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 0 points 4 months ago

    That we can.

    At the company where I've been the lead developer for fifteen years, sentiment is split down the middle - half think as I do, half think as you do. In (nearly) every instance where one of the opposing developers shows me nonsense, it's been easy to identify the cause: a lazy prompt with insufficient context. Garbage in, garbage out.

    Having seen the results of the US elections, I don't think anyone should trust humans. Yet here we are.

    As for temperature, yes, I'm aware of the parameter. The human equivalent would be genetic mutation, although we can't alter ours on the fly.

    Thank you for the civil discussion. Until next we butt heads in the threads 👋

  • source
  • parent