[Top panel] OpenAI/GPT says: I apologize for the mistake. There is only **one** R in the word "strawberry." [Bottom panel] The commander of a US submarine says: A $40 million computer tells you there is one "R" in strawberry, but you don't believe it, and you come up with this on your own?

all 5 comments

sorted by: hot top controversial new old
[–] 8 points 1 year ago

This poor cat is still confused.

  • source
  • [–] 11 points 1 year ago

    Alan Turing must be turning over in his grave now..

    Sad times we live in, fuck AI.

  • source
  • [–] 5 points 1 year ago

    Sometimes I wonder if they are trying to be funny.

  • source
  • [–] 3 points 1 year ago

    This happens because LLMs operate on tokenized data, and they don't really "see" the text in the form of individual characters.

    You can quite reasonably get an LLM to generate a script that does the character counting and then run the script, to arrive at the correct answer.

  • source
  • [–] 5 points 1 year ago

    The funny thing is that deepseek doesn't make this mistake.

  • source
  • 28 comments in c/memes@lemmy.world view that post
    [–] 52 points 1 year ago* (4 children)

    At my work, it's become common for people to say "AI level" when giving a confidence score. Without saying anything else, everyone seems to perfectly understand the situation, even if hearing it for the first time.

    Keep in mind, we have our own in-house models that are bloody fantastic, used for different sciences and research. We'd never talk ill of those, but it's not the first thing that comes to mind when people hear "AI" these days.

  • source
  • hideshow 4 child comments
  • [–] 8 points 1 year ago (3 children)

    "Keep in mind, we have our own in-house models that are bloody fantastic, used for different sciences and research."

    I'm a scientist who has become super interested in this stuff in recent years, and I have adopted the habit of calling the legit stuff "machine learning", reserving "AI" for the hype machine bullshit

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago

    Lmao I'm doing the exact thing. I'm a ChemE and I have been doing a lot of work on AI based process controls and I have coached members of my team to use "ML" and "Machine Learning" to refer to these systems because things like ChatGPT that most people see as toys are all that people think about with "AI." The other day someone asked me "So have you gotten ChatGPT running the plant yet?" And I laughed and said no and explained the difference between what we're doing and AI that you see in the news. I even have had to include slides in just about every presentation I've done on this to say "no, we are not just asking ChatGPT how to run the process" because that's the first thing that comes to mind and it scares them because ChatGPT is famously very prone to making shit up.

  • source
  • parent
  • [–] 1 point 1 year ago

    It's certainly becoming easier, but I don't like it.

    We have a cool AI that's a big problem solver, but its outputs are complex. We've attached a GPT onto it purely to act kind of like a translator or summariser to save time trying to understand what the AI's done and why. It's great. But we definitely don't see the GPT as offering any sort of intelligence, it's just a reference based algorithmic protocol bolted onto an actual AI. Protocols are, afterall, a set of rules or processes to follow. The GPT isn't offering any logic, reasoning, planning, etc. which are still the conditions of intelligence in computer science. But it certainly can give off the impression of intelligence as it's literally designed to impersonate it.

  • source
  • parent
  • [–] 5 points 1 year ago

    This hits hard. I was in college when I first learned a machine solved the double pendulum problem. Problem is we have no idea how the equation works though. I remember thinking all the stuff machine learning could solve. Then they over hyped these LLMs that are good at ::checks my notes:: chatting with you.....

  • source
  • parent
  • [–] 24 points 1 year ago (14 children)

    It's not wrong though...There's one r and one rr in strawberry

  • source
  • hideshow 14 child comments
  • [–] 12 points 1 year ago (12 children)

    Found the Spanish speaker (they count rr as a separate letter)

  • source
  • parent
  • hideshow 12 child comments
  • [–] 4 points 1 year ago (4 children)

    Nope, I can order beer in spanish (no more than 10 at a time) and that's about it.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 1 year ago (3 children)

    Is the limit because you only know number up to 10 or because after that your drunk or a little bit of both?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 4 points 1 year ago (6 children)

    Don't think those are separate letters. Just pronounced differently. I mean, rr is just 2 r's. Not a new letter. And this isn't an ß-type case either. Phonetically different, yes. Different letters? Creo que no. Could be wrong, though. Hispanohablantes de Lemmy, corrijanme

  • source
  • parent
  • hideshow 6 child comments
  • [–] 2 points 1 year ago (5 children)

    In Spanish, up until 1994, "ll" and "ch" were considered distinct letters from the component parts. But "rr" has never been considered distinct from "r," even though it is pronounced differently, in large part because no words start with "rr" and any word that starts with "r" is pronounced with the rolling R sound.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 1 year ago (3 children)

    Aren't all R's rolling, though? Some longer and some shorter. I.e. rr and r. Guess I get it, though. Words starting with a single 'r' are pronounced like 'rr'. Interesting on the 'll' and 'ch' bits, too. Wasn't aware ¡Gracias, RAE!

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago (2 children)

    No, single r is tapped not rolled. It's similar but still a different sound

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 1 year ago (1 child)

    Oh, okay. Sounds similar. Sounds like rolling, but just once. Rolling if you turn off the looping option. I am not a linguist, though, so I don't know the intricacies of sounds

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 1 year ago (7 children)

    I asked this question to a variety of LLM models, never had it go wrong once. Is this very old?

  • source
  • hideshow 7 child comments
  • [–] 15 points 1 year ago* (2 children)

    Try "Jerry strawberry". ChatGPT couldn't give me the right number of r's a month ago. I think "strawberry" by itself was either manually fixed or trained in from feedback.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 10 points 1 year ago

    Smaller models still struggle with it, and the large models did too like a year ago

    It has to do with the fact that the model doesn't "read" individual letters, but groups of letters, so it's less straight forward to count letters

  • source
  • parent