If LLMs are conscious then openAI and anthropic are slave traders :) I don't know why they keep perpetuating that story
post
Painful watching people who have clearly never bothered to read even the shortest excerpt of philosophy try to have a philosophical discussion
How are people STILL making the same tired arguments in 2026? I got paywalled before I reached the third reason but this is like baby's first intro to the consciousness debate and it utterly fails as a logical argument. Both of the points I was allowed to read (intelligence =/= consciousness and silicon =/= brain matter) say very little about the nature of consciousness.
It's correct that intelligence is not proof of consciousness-- but this fact says nothing about proving non-consciousness of any entity, only that it is not sufficient to prove consciousness. Even working on vibes, the correlation goes in the direction that implies a link between intelligence and consciousness, although again, the correct message to take here is "intelligence does not prove consciousness", not "intelligent things [are / are not] conscious". There is simply no proven causal relation.
The "computers aren't brains" argument is also incredibly dumb. There are some fun thought experiments here, but tl;dr there is nothing proven to be mechanically special about brains as opposed to any other physical system that would cause consciousness. A non-physical difference (ie. a soul) would be a good thing to point to, but proving the existence of a soul or some similar unique non-physical property of humanity is pretty much exactly as hard (maybe harder!) than proving the existence of a conscious experience.
Note that this does not mean I believe that LLMs are conscious. I'm simply pointing out that this article is built on arguments that are so flawed, and well-known to be flawed, that treating it as a serious addition to the conversation is worse than valuing AI slop. Thank you for coming to my TED talk.
earlier this year, AI company Anthropic in San Francisco, California, published research claiming to have identified computational signatures of a form of consciousness in its Claude model1.
These AI companies happily let their AIs escape containment to hack sites so they can claim yet another headline as if its an ad. This claim too will be made of the same bullshit, its just "please give us more money"
Nobody can even agree on a concrete definition of consciousness so I'm not going to bother reading these 'reasons'.
Wait are you implying you think LLMs could be conscious? Fuckin hell we're cooked.
Define 'conscious'.
Sapient, salient, sentient, self-aware. An LLM can't be any of those things any more than an abacus can be. But I'm sure you're just gonna devolve into philosophical rhetoric about nature of consciousness that still isn't actually relevant but that will allow you to apply it to your misunderstanding of how LLMs function. This thread is apparently an AI bro brigade and I'm not interested in engaging with a bad faith group.
you seem more bad faith than the group
Says the AI bro. Seriously your comment history is public, your whole account just glazes AI.
Since you want to look at my comment history, consider actually reading next time. I am as far from an AI bro as you can be, but it's easier for you to think so instead of considering arguments.
Read the thread. Everyone defending the idea that LLMs can be conscious are spiraling off into theory of mind that isn't actually relevant or applicable. One dude's whole argument is based off his totally unproven assumption that consciousness is a property of the physical structure of brains which is both limited and misguided. There are no serious arguments here, just philosophizing.
Just because we don’t know what it is doesn’t mean we can’t know what it isn’t.
Nobody can even agree on a concrete definition of consciousness
Not only is that false, it doesn't make logical sense...
Lots of people agree on a different definitions of consciousness.
And most of the ones educated on the topic all agree on the same thing.
A bunch of people who never bothered to try and learn about something not understanding it, doesn't mean anything.
That's because there's different levels of such a thing. Way too many people use the term "sentient" (even me) and yet that's not even what AGI is aiming for. "Sapient" is the right word. And I doubt there's solid consensus on what and how it occurs within the fields of experts.
But I'm not an expert, so I wouldn't pretend to know. I have seen debates between people who do know more, and the fact there's debates concludes it's not settled at all.
People debate about the earth being flat, not a good metric to determined what is "settled"
The debate on consciousness are on par with Copenhagen interpretation versus pilot wave versus multiple words - except the underlying theory they're trying to describe is also not well defined
We can only practically describe subsets of what's required for some basic functions, and we can describe a bunch of chemistry, some brain activation patterns, etc. But nobody can tie that together to why we feel what we feel (and some don't agree that qualia is real, that perception itself is an illusion)
I don't think there are debates about that. There's whatever they say, and there's the few that make content by saying, "okay, let's take a deep breath and pretend there's anything to work with, and go from there".
Actual modern flat Earth was a spoof, I believe, but enough people with low science education and some religion ran with it as having anything worthwhile. And there's the few that don't believe it but feed off those others, keeping it going.
Please read the article. It contradicts you, and argues that LLMs aren't consciousness cause they can think of, count em, 3 niche theories that the authors like which are impossible for anything not made of meat to qualify for.
And most of the ones educated on the topic all agree on the same thing.
Source?
Not only is that false, it doesn't make logical sense...
Argument by assertion and you haven't proven the assertion
Lots of people agree on a different definitions of consciousness.
Lots of people can't agree on a different definition. Is there a different definitions then by it's very nature people do not agree.
Nobody can even agree on a concrete definition of consciousness
I agree with myself...
Nobody can ever agree on _____
Isn't a logically sound statement.
Not everyone can agree on _____
Is logical, but means nothing because a single flat earther means we can't all agree the earth is round
I thought that was obvious...
Lots of people can’t agree on a different definition. Is there a different definitions then by it’s very nature people do not agree.
But you clearly don't understand the difference...
It's really not difficult. You made a statement that stated that you believe that there is consensus, so presumably that means that you know where that consensus exists, therefore provide a link to it. If you cannot then you cannot make the assertion that consensus exists, because by definition it doesn't.
Your entire argument rests on the basic idea that there is a scientific definition for consciousness and we have a test for if something is conscious or not. There is no test because there is no consensus. It is not possible for you to prove through scientific rigor that you are conscious, and presumably you're human. So how can they possibly be consensus on something as contentious as artificial intelligence?
I downvoted this when you first posted it but I came back to find it has 50-something upvotes, so I feel compelled to respond.
It’s obvious that you haven’t read the article since literally the second fucking sentence defines exactly what the author means by “consciousness”: “the capacity for subjective experience.”
So, your comment is completely useless. And it’s mostly wrong.
I'm not really sure what the point of having a conversation about consciousness is. As far as I'm aware no one has ever actually been able to define consciousness in such a way that it could be tested for.
So how could we possibly know one way or the other?
Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness
Oh great so we've only just started the article and we're already mudding the waters. This bodes well. There is no reason to necessarily believe that a system has to be conscious in order to be intelligent. We have multiple examples of consciousness without intelligence (see my fat cat) so there's no reason to believe that the inverse can also not be true.
Woah woah woah my friend. I'm here for most of your conversation, but to talk shit about your CAT!? I draw the line. They may not exibit the type of intelligence we have, but cats are smart AF! Who cleans you cats shit and piss up!? Hmmmmmm? Who feeds them daily with only minor vocalizing!? That cat basically made you their slave and didn't even have to threaten you!
GENIUS!!!
LLMs have only gotten to a few trillion parameters, whereas a human brain has 100 trillion synapses. They’ll catch up to humans soon enough if only the tech bros can get a trillion dollars for each trillion params.
Also, those 100 trillion neurons do a fuck tonne more than just putting words together.
LLM's at the core are just distance measurement databases between words. Dont tell me AI is conscious, it's a fucking database
So humans are the only consciouse beings. And nothing with fewer connections could ever he conscious
Consciousness is a feedback loop, of a sort that current LLMs do not have. However, there's nothing preventing someone from writing different software that does have that sort of feedback loop. Doing this would be a bad idea, but someone will probably eventually do it if they haven't already.
We can make something artificial of something we dont understand the biological form of. Also if AI happens its not going to be an LLM Markov chains have nothing to do with thinking.
Those who think that generative AI is 'conscious' don't understand that it can only do what it is trained on. It can produce impressive outputs only because it fuses together data taken without permission from millions of people, not because it's intelligent or conscious in its own right.
The funniest exercise is to ask any LLM for a short story and they all come up with Elias the lighthouse keeper visited by Maria or some variation on that theme. That's not creative or conscious.
I actually agree with you about AI, but I'm sure if you asked the average person to come up with a short story multiple times you would also see a pattern in names and themes. They're probably going with names in their own language, or if they read fantasy and are influenced by that they may use names that seem stereotypically fantasy oriented. I don't think AI is conscious, but just because something has tendencies doesn't mean it's not creative or conscious.
Not only that, they only act when directed. There's zero idle "thought" when they're not actively performing a task.
We would be the same if our senses only updated when someone allowed them to. But we have real time input. There's nothing stopping AI from having real time input, apart from simple system design decision.
You are able to think even when there's no other senses giving input. LLMs have no idle processing. No random stray cycles about what it previously worked on.
Yes, but the state of the neural network can be it's own input, allowing continuity from moment to moment, based on the number of refreshes we allow it or the hardware is capable of making. That's what we're doing when we think, we're dwelling on the state of our current moment - in this sense, they would also think even when there's no other senses giving input.
This is strictly false, generalization in LLMs is well documented.
It's also not relevant. Read the first point in the article: intelligence != consciousness. Individual ants, bats, and fish do not do anything very creative (certainly less creative than gpt-2), yet they are probably all conscious.
That's not the reason, we're in the same boat when it comes to knowledge in many ways.
But we don't even know what consciousness is so it's a waste of time reading the "3 reasons (*potential)" IMO.
Also an LLM only produces output when it is prompted to do so. Between prompts it's not sitting there - waiting, wondering about the meaning of life, getting bored - until you prompt it again. It's basically dead.
I like to compare llms to a Galton Board. Instead of the regular layout of pins someone added or removed pins so the marbles on the bottom fall into nice to look patterns.
Also an LLM only produces output when it is prompted to do so.
Why is this a good measure of consciousness?
If continuity isn't relevant for qualia, then LLMs could have perpetually incomplete perception like the edge of the image drawn on a CRT screen when captured at high frame rates. You never see a complete picture even if it's technically represented.
There's nothing stopping someone from wiring a camera, sensors, and motivators to a collection of neural networks, and have one parent neural network control them all. That would approximate the hemispheres of our brains.
It would not come remotely close to approximating our brains, in any way. This exhibits a lack of understanding of both LLMs and how our brains function.
That's a valid opinion, but it is the opposite of mine. Agree to amicably disagree?
I'd like to know what evidence you have to support your position. I'm sure true artificial intelligence is theoretically possible but existing LLMs and other models cannot be that, not while maintaining a definition of intelligence that at all implies "like us" which is the only really useful definition.
Just insight and intuition gained from twelve years of post-graduate study at Universities, including a MSc in Machine Learning.
I'm not sure "like us" is something that is quantifiable. I'm of the belief that treating we meat automatons as anything special is hubris. We're finite state machines, acting on information input from our senses, making decisions, and outputting information in the form of activating biological apparatus. Swap physical for digital, and LLMs are indeed capable of aping all of our behavior.
Case in point have they ever turned on a model and left it for it to, on its own, decide "wait what's going on, who am I, what/where am I?". And start independently exploring?
Highly doubt it. If so, we're cooked
By identifying"memories" they can include the information in the context of the next update - this is akin to our short term memory. Make it self pruning, where the data is saved locally but not included in the next context, and it acts the same as own memory system.
Reasons given:
- Intelligence is not consciousness
- Silicon brains are not made of meat
- Consciousness requires meat (and/or a particular winding of neurons)
And point 3, as far as I can tell from this argument, isn't serious. It merely asserts that there are some models of consciousness that would prevent us from using the term for AI. But the models aren't 'popular', 'widespread', or justified at all afaict. It's just that the author has a pet causal mechanism they made up. It's also pretty abelist by my read.
integrated information theory (IIT), starts from the essential properties of consciousness — those that are true of every experience we can have. For instance, we experience every visual scene as a single, integrated whole: its left and right side, colours and shapes are bound together to make the experience what it is.
In other words, if you've got any sort of trouble integrating a visual scene, then you aren't conscious. Sure.
These are, to be frank, really weak. They say on point 2:
Computational functionalism ... is popular among some scientists and philosophers, too, but we think it is fatally flawed because brains are not — or at least not just — computers that are made of meat.
One main reason is that it is impossible to separate what biological brains do — their functional organization — from what they are — their material substrate. In other words, there is no distinct separation between the mind and living tissue in the human brain, as there is between software and hardware in a digital computer.
Restating clearly: Ghosts are real. The mitochondria is not only the powerhouse of the cell, it also gives you mystic powers.
Really? The source they site for this point features the lovely assumption "consciousness is unique to biological life". From this axiom, I see how the conclusion follows, but I don't see why we should believe this axiom. We can do physics emulation of every atom in a fruit fly on a computer...
This analysis is correct but I have a minor quibble: The simulated fruit fly brain is not a complete simulation of the biological processes, or even all the neuronal connections, of the actual fly's brain.
@Feathercrown@artISAn #consciousness #AI #brain #neuroscience #computer #functionalismEven a “complete simulation” of a fruit fly brain would be no more than an approximation. I think you mean “emulation” and I agree. The simple reason is that we do not know scientifically all of necessary and sufficient functional mechanisms of consciousness, nor consciousness’s functional role in “intelligence” (which we also have trouble describing). If, and only if we we did, we would (given the right tools) be able to replicate it functionally (in principle) using computation. Specifically, I refer to a Universal Turing Machine (UTM) and the Church-Turing Thesis (the foundational principle of all computer science). EVEN THEN, there are computational problems that cannot be proved to be solvable by a UTM (e.g., the Halting Problem) and we don’t know what, if any role they play in consciousness. Bottom line for me: we are going to need a revolution in each of the sciences of psychoneurophysics, mathematical logic, and theory of computation before we can begin to talk about replicating consciousness in a machine.
I don't see why we would necessarily need to understand consciousness to create it. There is no evidence that nature understands the consciousnesses it has created. In fact a human can create a new consciousness in about 9 months without knowing any theory.
The question in my mind is, how could we possibly tell we've succeeded? We can't even say for sure that anyone other than ourselves is conscious.
@Feathercrown Maybe all you need are the right ingredients? I don’t think so. There must be a recipe. Human ontogenesis proceeds according to a process specified in our genes, modified a bit by the developmental environment. We don’t fully understand that process completely (AFIK) but there are no intrinsic obstacles. #Mind emerges at some point. You are right about the question of recognizing consciousness. People are predisposed to attribute life, intentionality, and all kinds of “mental states” to all kinds of inanimate objects given the flimsiest evidence. The more something resembles ourselves, the quicker and deeper the belief is held. I’m not sure consciousness is even required. It may be an illusion. It may be an artifact. It does not matter to the prospect of extremely powerful #AI systems. I fully expect models to assert consciousness and make demands on that basis. True or false, what do we do in that situation?
I'm not sure our society is ready to answer that sort of question.
@Feathercrown We are not ready, in the sense of thinking about the question thoroughly, but we don’t get to choose when it comes. I am hopeful, however, seeing the progress humanity has made in recognizing intelligence and self-awareness in other species. The human-centric bias is on the wane.
(I admit to using the very royal we, as in 'humanity knows how to do this, more or less' and 'given we mine the asteroid belt for a big enough computer'.)
In other words:
- Statement that does not prove anything is or isn't conscious
- Unsupported assertion
- Unsupported assertion
Wow, very convincing article! I wish I'd thought of that! /s
I'll give them mildly more credit; they cite sources for 2 and 3. The sources just don't seem convincing at all imo.
Those sound like arbitrary assertions to me, which no backing apart from the authors personal beliefs
Point 1 is surely true, but also not helpful. The most persuasive example inside is the classic:
Similar to an LLM, AlphaFold is a powerful neural network running on silicon hardware. Yet almost nobody worries that it might be conscious. That’s because AlphaFold predicts protein structures, whereas LLMs ‘talk’ to us.
You can read this both ways...
Current systems, no. But it brings up the question of how we deal with it when we create something where we truly don't know, because we can never say for certain whether it is or isn't.
top 78 comments