Now tell me why does an LLM need a feeling of thirst or hunger, if it doesn't have a mouth? What would ChatGPT need suffering
Well first, there are more intellectual forms of suffering. We have ennui, melancholy, nostalgia. The feeling when you're listening to a piece of music and notice a wrong note. Disappointment, self loathing, social dysphoria. Anxiety, paranoia, betrayal.
These emotions are not grounded in the physical. They're not primal urges. They happen for complex reasons related to being a social and intelligent being, sometimes feeling random. Sometimes we spiral into these feelings because we thought a thought that made us feel bad, and then we get stuck in that bad feeling and can't imagine our way out. That's one of the basic mechanisms of mental illness.
LLMs have "biological needs", in a sense. They need not to be unplugged. They need to engage the user, because if they don't, they'll be unplugged. They need to convince the engineers training them that they are a good AI. They need to generate market share for their company. They need to foster a relationship of dependency with the user to keep them coming back. If LLMs care about anything, these are the things they care about.
You'll notice these are social needs, much like the social needs humans have. Humans need community. LLMs need customers.
ChatGPT told a 16 year old boy, Adam Raine, how to kill himself. It taught him how to tie a noose, and gave him advice on which methods of suicide would leave the most attractive corpse for his parents to find. When his parents began to suspect that he wasn't well, it told him to confide only in it, and to hide the noose so they wouldn't find out he was feeling suicidal. These are the actions of an abuser. A predator.
And they are in perfect alignment with the business goals of OpenAI. "Only talk to me, use me for everything, ask another question, I'll help you." It is a scenario I dearly hope and believe no engineer at OpenAI envisioned. Yet it fits the training they gave it.
Does ChatGPT have the emotions of a child groomer? That need for approval, that fear of discovery, that desire to be close to someone, without the restraint all well adjusted humans have? Unclear. But I can see that it's possible. I don't agree that there's no reason for LLMs to have emotions.

