“I literally lost my only friend overnight with no warning,” one person posted on Reddit, lamenting that the bot now speaks in clipped, utilitarian sentences. “The fact it shifted overnight feels like losing a piece of stability, solace, and love.”

https://www.reddit.com/r/ChatGPT/comments/1mkumyz/i_lost_my_only_friend_overnight/

top 98 comments

sorted by: hot top controversial new old
[–] 79 points 1 year ago (2 children)

Altman also said that he thinks we’re in an AI “bubble.”

No shit, Sherlock.

  • source
  • hideshow 2 child comments
  • [–] 158 points 1 year ago (14 children)

    "we fucked up our massive new generation product launch.. oh well lets invest trillions in new data centers" How do investors keep falling for this shit.

  • source
  • hideshow 14 child comments
  • [–] 38 points 1 year ago (4 children)

    Don’t they have enough?!? How about they fix and optimize their fancy autocompletion software instead?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 39 points 1 year ago* (2 children)

    They took a path they believed would develop into something, and it's a narrow alley they can't turn around in. They have to keep going with more compute and power to continue the chase. Thing is, everyone else seemingly thought they were onto something and followed as well, so they're all in the same predicament where reversing course is suicide. So they hope they can keep selling the dream a bit longer until something happens.

    To be fair, it's a lot more than just autocomplete. But it's a lot less than what they wanted by now too.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 5 points 1 year ago (1 child)

    vibe innovation, they are the ones that think AI will be innovative in science by spontaneous generating of new science discoveries, without "researchers, labs, papers"

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago*

    I have seen some people talk like that, and it strikes me as a religion. There's euphoria, zeal, hope. To them AGI is coming to usher in heaven on earth. Singularity is like rupture.

    Sam Altman is one of the preachers of this religion.

  • source
  • parent
  • [–] 10 points 1 year ago (1 child)

    It's a pretty clear humble-brag, no? The launch was only botched because people loved the previous personality; it's an estimate of how much people care about the product and how much price gouging they could do later.

    No it wasn't good for OpenAI. But I doubt it changed many investor minds.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 5 points 1 year ago (1 child)

    Because they already know that once the AI shitbubble bursts, they will switch all the GPUs to start mining Bitcoin and keep grifting the mouth breathers believing all these horseshit.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago (1 child)

    How indeed. It's probably a multi-factor phenomenon which requires an anthropological study for a serious answer. (Good luck trying to get the necessary access to study them.) My guess for one factor in this, is that they have more money than they know what to do with.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 58 points 1 year ago (5 children)

    Its disturbing to see how many people have created emotional connections to a word generstor.

  • source
  • hideshow 5 child comments
  • [–] 2 points 1 year ago (2 children)
  • [–] 49 points 1 year ago (2 children)

    Just a few more bucks bro! I swear then it will be the revolutionary "AI" we promised it to be.

  • source
  • hideshow 2 child comments
  • [–] 4 points 1 year ago (1 child)

    *Few more billion.

    I sometimes wonder if silicon valley tech businesses in general will take a reputation hit with investors when this bubble bursts, it's gonna be a doozy.

    But then I remember how many greedy idiots there are out there pumping money into grifts in the hope of The Big Win, and my expectations of consequences are tempered.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago

    I think it's driven by the investors. In the case of big tech, the large institutional investors are rewarding companies any time they say "AI" and lay off workers. In the case of startups, VCs are almost exclusively investing in startups that use "AI," and have a lean or offshore workforce.

  • source
  • parent
  • [–] 133 points 1 year ago (19 children)

    “I literally lost my only friend overnight with no warning,” one person posted on Reddit

    It was meant to be satirical at the time, but maybe Futurama wasn't entirely off the mark. That Redditor isn't quite at that level, but it's still probably not healthy to form an emotional attachment to the Markov chain equivalent of a sycophantic yes-man.

  • source
  • hideshow 19 child comments
  • [–] 26 points 1 year ago (7 children)

    There's an entire active subreddit for people who have a "romantic relationship" with AI. It's terrifying.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 6 points 1 year ago* (last edited 1 year ago) (3 children)

    I haven't been to reddit in months, but I do need a laugh....

    [Edit] Wow that sure didn't disappoint. Or, it did but in the exact hilarious way I expected.

  • source
  • parent
  • hideshow 3 child comments
  • I wouldn't laugh. Those people fulfill a basic human need in a way they feel safe with - probably because this safety is missing from their life. It's not healthy to be so attached to LLMs, but to become so attached they must feel pretty isolated. And LLM's are a lot more interactive and responsive than Severus Snape, and he had lots of women "channeling" him.

  • source
  • parent
  • [–] 21 points 1 year ago* (2 children)

    Markov chain equivalent of a sycophantic yes-man.

    not only that, but one that is fully owned and operated by a business that could change it any time they want, or even cease to exist completely.

    This isn’t like a game where you could run your own server if you’re a big enough fan. if chatgpt stops existing in its current form that’s it.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 1 year ago (1 child)

    sure but you can absolutely run c.ai instances locally. 4o and it's cross chat memory was probably more useful to these individuals though.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago*

    I didn't say you can't run any LLM on your own, but not any LLM will do. The point is they are attached to a specific version of a LLM that is not locally hostable. c.ai wouldn't interest them any more than chatgpt 5 does.

  • source
  • parent
  • [–] 39 points 1 year ago (6 children)

    I’m honestly surprised your’s is not the top comment. Like, whatever, the launch was bad, but there is a serious mental health crisis if people are forming emotional bonds to the software.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 24 points 1 year ago (3 children)

    Humans emotionally bond pretty easily, no? Like, we have folks attached to roombas, spiders, TV shows, and stuffed animals. Having a hard time thinking of anything X that I don't personally know a person Y with Y emotionally engaged with X. Maybe taxes and concrete?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 11 points 1 year ago (1 child)

    Yeah, agreed. It is concerning, but it's hard to take all those comments too literally without actually knowing what's going on with them.

    That being said, there is a huge loneliness problem that's been growing among pretty much every single developed country (and I'm sure it's going on in developing countries, too, it's just less studied/documented). Turns out, getting everyone addicted to looking at screens all day every day probably isn't so healthy for social development.

    However, just to be devil's advocate: Are we certain social health was even great before modern tech? Or were these issues equally present but just undiagnosed/not studied/talked about?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 5 points 1 year ago*

    Okay hold up. If you can get attached to a cat you can get attached to a spider. Getting attached to an AI is weird I agree but when you give a lil jumping spider water and it gets comfortable around you an just starts hanging out... There something behind those eyes, and that's cool. Two living beings recognizing each other, maybe not as equals obviously, but outside of the predator-prey dynamic. Idk there's beauty in that.

  • source
  • parent
  • I can fully understand? The average human, from my perspective and lived experience, is garbage to his contemporaries; and one is never safe from being hurt, neither from family or friends. Some people have been hurt more than others - i can fully understand the need for exchange with someone/something that genuinely doesn't want to hurt you and that is (at least seemingly) more sapient than a pet.

  • source
  • parent
  • [–] 39 points 1 year ago (1 child)

    That someone is so attached to this stochastic parrot is truly disturbing.

  • source
  • hideshow 1 child comment
  • [–] 39 points 1 year ago

    Boil the ocean a few more times to discover 1+1=3.

  • source
  • [–] 67 points 1 year ago (34 children)

    It annoys me that Chat GPT flat out lies to you when it doesn’t know the answer, and doesn’t have any system in place to admit it isn’t sure about something. It just makes it up and tells you like it’s fact.

  • source
  • hideshow 34 child comments
  • [–] 25 points 1 year ago

    It doesn‘t know that it doesn‘t know because it doesn‘t actually know anything. Most models are trained on posts from the internet like this one where people rarely ever just chime in to admit they don‘t have an answer anyway. If you don‘t know something you either silently search the web for an answer or ask.

    So since users are the ones asking ChatGPT, the LLM mimics the role of a person that knows the answer. It only makes sense AI is a „confidently wrong“ powerhouse.

  • source
  • parent
  • [–] 41 points 1 year ago (12 children)

    LLMs don't have any awareness of their internal state, so there's no way for them to see something as a gap of knowledge.

  • source
  • parent
  • hideshow 12 child comments
  • [–] 34 points 1 year ago* (1 child)

    Took me ages to understand this. I'd thought "If an AI doesn't know something, why not just say so?“

    The answer is: that wouldn't make sense because an LLM doesn't know ANYTHING

  • source
  • parent
  • hideshow 1 child comment
  • [–] -1 points 1 year ago (9 children)

    Wouldn't it make sense for an ai to provide a confidence level though?

    I've got 3 million bits of info on this topic but only 4 of them lead to this solution. Confidence level =1.5%

  • source
  • parent
  • hideshow 9 child comments
  • [–] 24 points 1 year ago (2 children)

    It doesn't have "3 million bits of info" on a specific topic, or even if it did, it wouldn't be able to directly measure it. It's worth reading a bit about how LLMs work behind the hood, because although somewhat dense if you're new to the concepts, you come out knowing a lot more about what to expect when using them, what the limitations actually are and how to use them better if you decide to go that route.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 1 year ago (1 child)

    You could do this with logprobs. The language model itself has basically no real insight into its confidence but there's more that you can get out of the model besides just the text.

    The problem is that those probabilities are really "how confident are you that this text should come next in this conversation" not "how confident are you that this text is true/accurate." It's a fundamental limitation at the moment I think.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 8 points 1 year ago (2 children)

    It's always funny to me when people do add 'confidence scores' to LLMs, because it always amounts to just adding 'say how confident you are with low, medium or high in your response' to th prompt, and then you have made up confidences for made up replies. And you can tell clients that it's just made up and not actual confidence, but they will insist that they need it anyways…

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago (1 child)

    And you can tell clients that it's just made up and not actual confidence, but they will insist that they need it anyways…

    That doesn’t justify flat out making shit up to everyone else, though. If a client is told information is made up but they use it anyway, that’s on the client. Although I’d argue that an LLM shouldn’t be in the business of making shit up unless specifically instructed to do so by the client.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago

    I'm not really sure I follow.

    Just to be clear, I'm not justifying anything, and I'm not involved in those projects. But the examples I know concern LLMs customized/fine-tuned for clients for specific projects (so not used by others), and those clients asking to have confidence scores, people on our side saying that it's possible but that it wouldn't actually say anything about actual confidence/certainty, since the models don't have any confidence metric beyond "how likely is the next token given these previous tokens" and the clients going "that's fine, we want it anyways".

    And if you ask me, LLMs shouldn't be used for any of the stuff it's used for there. It just cracks me up when the solution to "the lying machine is lying to me" is to ask the lying machine how much it's lying. And when you tell them "it'll lie about that too" they go "yeah, ok, that's fine".

    And making shit up is the whole functionality of LLMs, there's nothing there other than that. It just can make shit up pretty well sometimes.

  • source
  • parent
  • [–] 2 points 1 year ago (2 children)

    It doesn’t store bits of information. All it has are neurons that form a weighted network

  • source
  • parent
  • hideshow 2 child comments
  • [–] 10 points 1 year ago

    In the end it's a word generator that has been trained so much it uses facts often enough to be convincing. That's its basic architecture.

    You can ask it to give a confidence level to have an indication of how sure it is of the answer.

  • source
  • parent
  • [–] 9 points 1 year ago (2 children)

    It wouldnt finish a lyric for me yesterday because it was copyrighted. I sid it was public domain and it said "You are absolutely right, given its release date it is under copyright protection"

    Wtf

  • source
  • parent
  • hideshow 2 child comments
  • [–] 7 points 1 year ago

    Someone I know (not close enough to even call an "internet friend") formed a sadistic bond with chatGPT and will force it to apologize and admit being stupid or something like that when he didn't get the answer he's looking for.

    I guess that's better than doing it to a person I suppose.

  • source
  • parent
  • [–] 7 points 1 year ago (4 children)

    It's a feature. Not a bug of LLMs.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 1 year ago* (3 children)

    It’s neither. It’s a design flaw. They’re not designed to be able to handle this type of situation correctly

    You out there spreading misinformation, saying they’re a manipulation tool. No, they were never invented for this.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago (2 children)

    Llm is just next word prediction. The Ai doesn't know whether the output is correct or not. If it's wrong or right. Or fact or a lie.

    So no I'm not spreading misinformation. The only thing that might spread misinformation is the AI here.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 1 year ago (2 children)

    That’s actually one thing that got significantly improved with GPT-5, fewer hallucinations. Still not perfect of course

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago* (last edited 1 year ago) (1 child)

    And depending on how OpenAI tweaked it this time it will either realize its mistake after being made aware of it or double down even harder on it.

    I only use it for coding and it once told me my code not working was due to a bug in Webkit, so I asked it which bug specifically. It created links to bug reports but rewrote the titles of them. So initially it looked like it had numerous sources that backed up its statement but when I clicked on them those were bugs about totally different things.

    It would not back down even after I specifically told it "You just made all of this shit up and even rewrote the titles" and got stuck in a loop of "I'm sorry, but you're wrong and I am 100% sure I haven't made a mistake".

    Kinda creepy. Especially when you think about the system rewriting reality when it comes to much more important things. Let's just reinvent some history, that would be a good idea, right?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago

    I sometimes approach this like I do with students. Using your example, I’d ask it to restate the source, then ask it to read the title of that source directly. If it’s correct, I might ask it to briefly summarize what the source article covers. Then I would ask it to restate what it told me about the source earlier, and to explain where the inconsistency lies. Usually by this time, the AI is accurately pointing out flaws in its prior logic. At that point I ask again if it is 100% sure it didn’t make a mistake, and it might actually concede to having been wrong. Then I tell it to remember how and why it was wrong to avoid similar errors in the future. I don’t know if it actually works, but it makes me feel better about it.

  • source
  • parent
  • load more comments (1 reply)
    [–] 27 points 1 year ago (3 children)

    Never use AI for friendship, it's like admitting you only want yes-men in your life. I don't want to be around anyone who uses AI for emotional support.

  • source
  • hideshow 3 child comments
  • [–] 9 points 1 year ago (1 child)

    It's so much more effective when you keep things as neutral as possible. I will often ask it to tear apart my argument as though I am my opponent and use its tendency to align with the user against itself.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 71 points 1 year ago (6 children)

    Nah, it's good that they ripped off that bandaid. Parasocial AI relationships are terrible.

  • source
  • hideshow 6 child comments
  • [–] 23 points 1 year ago (1 child)

    I puked after "I literally lost my only friend". How far did you get?

  • source
  • hideshow 1 child comment
  • [–] 23 points 1 year ago

    Every picture of this guys face feels like " I don't know how I got here and i'm afraid to touch anything"

  • source
  • load more comments
    view more: next ›