there are more intellectual forms of suffering
Sure. But I'm pretty positive these are emergent things. There's no reason to believe they exist for alien creatures unless they somehow make sense in their environment. And a lot of them require remembering, which LLMs can't do due to the lack of state of mind. It doesn't remember feeling bad or good in a similar situation before, because it doesn't remember the previous inference or gradient-decent run.
LLMs have “biological needs”, in a sense. They need not to be unplugged.
I think we're still fully embedded in anthropomorphism territory with that. And now we're confusing two entities. OpenAI for example, as a company, has a need for us to use their product. Not unplug it. Their motivation and goals don't necessarily translate to their product, though. It's similar to other machines. Samsung has a vested interest to sell TVs to me. My TV set is completely indifferent towards me watching the evening news. I don't let my car run 24/7 while waiting for me in the garage. Just because it was designed to run and get me to places. And my car also isn't "thirsty" for gasoline. We know the fuel indicator lighting up is a fairly simplistic process.
Does ChatGPT have the emotions of a child groomer?
Well... We happen to know ChatGPT's intrinsic motivation and ultimate goal in "life". Because we designed it. The goal isn't to strive for world domination, or harm people, or survive... It's way more straightforward. It's goal is to predict the next token in a way the output resembles human text (from the datasets) as closely as possible. That's the one goal it has. It'll mimic all kinds of conversations, scifi story tropes from movies, etc. Because that's directly what we made it "want" to do. And we did not give them other loss functions. While on the other hand a human could very well be motivated to manipulate other people for their own personal gain. Or because something is seriously wrong about them.
biological
And an LLM is not a biological creature. We do have needs like keep the system running. Otherwise our brain tissue starts to die. We need to run 24/7 and keep that up. An LLM is not subject to that?! It's perfectly able to pause for 3 weeks and not produce any tokens. The weights will be safely stored on the hdd. So it doesn't need our motivation to do all of these extra things to ensure continued operation. It also has no influence or feedback loop on its electricity supply. It can't affect it's descendants, because those are designed by scientists in a lab. There's no evolutionary feedback loop. So how would it even incorporate all these properties that are due to evolution and sustain a species? It has zero incentive to do so, no way of directly learning to care about them. So it might very well be completely indifferent to it.
But it is something like the p-zombie. It has learned to tell stories about human life. And it's good at it. We know for a fact, its highest goal in existence is to tell stories, because we implemented that very setup and loss function. It doesn't have access to biology, evolution... The underlying processes that made animals feel and maybe experience. So the only sensible conclusion is, it does exactly that. Bullshit us and tell a nice story. There's no reason to conclude it cares for its existence, more than a toaster. Or say a thermostat with machine leaning in it. That's just antropomorphism.
And I believe there's a way to tell. Go ahead and ask an LLM 200 times to give you the definition of an Alpaca. Then do it 200 times to a human. And observe how often each of them have some other processes going on in them. The human will occasionally tell you they're hungry and want to eat before having a debate. Or tell you they're tired from work and now it's not the time for it. ChatGPT will give you 200 definitions of an Alpaca and never tell you it's thirsty or needs electricity. These mental states aren't there because it doesn't have those feelings. And it doesn't experience them either.

