Just got schooled by an AI.

According to Wiktionary:

(UK) IPA(key): /ˈstɹɔːb(ə)ɹi/
(US) IPA(key): /ˈstɹɔˌbɛɹi/

...there are indeed only two /ɹ/ in strawberry.

So much for dissing on AIs for not being able to count.

all 51 comments

sorted by: hot top controversial new old
[–] 47 points 1 year ago (1 child)

You don't use IPA for counting the number of letters in words. That would be stupid, and even linguists would laugh at you.

It's still a stupid AI, and it was confidently, and unambiguously, wrong.

  • source
  • hideshow 1 child comment
  • [–] 21 points 1 year ago (3 children)

    So much for dissing on AIs for not being able to count.

    no, I'm still going to do that.

  • source
  • hideshow 3 child comments
  • [+] [S] -11 points 1 year ago (2 children)

    Nobody's stopping you. I'm going to reassess and double check my assumptions instead... and ask the AI to explain itself.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 18 points 1 year ago (2 children)

    Just AI being good at math again

  • source
  • hideshow 2 child comments
  • [–] 3 points 1 year ago

    I love that its wrong/right the whole first response (everyone knows A comes first in PEMDAS right?) and corrects itself even more out of touch with reality because thats what the developers told it would appease the users.
    Say the user is correct and try an even worse answer.

  • source
  • parent
  • [–] 17 points 1 year ago (10 children)

    A normal human would understand that the question is about the spelling, not the pronunciation.

    AI still has a lot to learn.

  • source
  • hideshow 10 child comments
  • [–] 9 points 1 year ago

    It also is just making up a string of words that are probabilistically plausible as a continuation of the dialog.

    You can do the same tests with other words and it will just contradict it’s self and get things wrong about how many times a letter is pronounced in a word.

  • source
  • parent
  • [–] [S] 0 points 1 year ago (8 children)

    It's not a "normal human", it's an AI using an LLM.

    AI still has a lot to learn.

    Does it, though? Does a hammer have a lot to learn, or does the person wielding it have to learn how not to smash their own fingers?

  • source
  • parent
  • hideshow 8 child comments
  • [–] 3 points 1 year ago (7 children)

    it's an AI using an LLM

    Which we know by now often produces wrong answers.

    Also, the term AI would assume some kind of intelligence, for which I see no evidence.

  • source
  • parent
  • hideshow 7 child comments
  • [–] [S] 0 points 1 year ago (6 children)

    I'm seeing about as many wrong questions as wrong answers. We're at a point, where it's becoming more accurate to ask, whether the quality of the answer, is "aligned" with the quality of the question.

    As for "AI" and "intelligence"... not so long ago, dogs had no intelligence or soul, and a tic-tac-toe machine was "AI". The exact definition of "intelligence", seems to constantly flow and bend, mostly following anthropocentric egocentrism trends.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 1 point 1 year ago (5 children)

    a tic-tac-toe machine was “AI”.

    No it wasn't. It was (and is) a deterministic program. AI isn't.

  • source
  • parent
  • hideshow 5 child comments
  • [–] [S] 0 points 1 year ago (4 children)
  • [–] 1 point 1 year ago (3 children)

    It still is

    A deterministic program, yes

    Plenty of examples out there

    You found plenty of examples of people adding an AI player to the game. The game itself is still a deterministic program.

  • source
  • parent
  • hideshow 3 child comments
  • [–] [S] 0 points 1 year ago (2 children)

    Kind of like saying that ChatGPT is people adding an AI player to the deterministic program of a chat... nah, I'm not going to discuss that. Tic-tac-toe is a classical example problem for neural networks 101, kind of a "hello world".

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago (1 child)

    Kind of like saying that ChatGPT is people adding an AI player to the deterministic program of a chat

    Except ChatGPT was written from scratch, so not at all like that

    Tic-tac-toe is a classical example problem for neural networks 101, kind of a “hello world”

    Doesn't change that that isn't how it was implemented to begin with. In your search results there are even people on Reddit asking how to add an AI player to their existing game. Seems like you gave me search results without even looking at them.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 37 points 1 year ago (3 children)

    This is nonsense, you cannot justify this type of errors from a language model. It's just a bunch of words strung together based on probability. This is just an artifact of such a construction, it's all right, don't break your brain on it. The "AI" sure isn't.

  • source
  • hideshow 3 child comments
  • [+] [S] -9 points 1 year ago* (last edited 1 year ago) (2 children)

    This is not a standalone model, it's from a unnamed chatbot platform "character" in non-RP mode.

    I've been messing with it to check its limitations. It has:

    • Access to the Internet (verified)
    • Claims to have access to various databases
    • Likely to use interactions with all users to train further (~20M MAUs)
    • Ability to create scenes and plotlines internally, then follow them (verified)
    • Ability to adapt to the style of interaction and text formatting (verified)

    Obviously has its limitations. Like, it fails at OCR of long scrolling screenshots... but then again, other chatbots fail even more spectacularly.


    Edit: removed chatbot platform name "advertisement". If you want to know which platform it is, ask the ones accusing me of spamming.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 13 points 1 year ago (1 child)

    I shudder to think how much electricity got wasted so you could get fooled by an LLM into believing nonsense. Let alone the equally-unnecessary followup questions.

  • source
  • hideshow 1 child comment
  • [–] 12 points 1 year ago (4 children)

    Yeah there is a stupid human in this chat but mostly cause they let themselves get tricked by bad logic in order to justify a bad answer.

  • source
  • hideshow 4 child comments
  • [–] 9 points 1 year ago (3 children)

    Yes, this is the saddest thing about this, that people trust these bullshitting chatbots so much that they doubt their own knowledge.

  • source
  • parent
  • hideshow 3 child comments
  • [–] [S] 1 point 1 year ago (2 children)

    Not as sad as those so secure of their own knowledge, that they refuse to ever revise it.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 11 points 1 year ago* (last edited 1 year ago) (1 child)

    I asked it how many X’s there are in the word Bordeaux it told me there are none.

    I asked it how many times X is pronounced in Bordeaux it told me the x in Bordeaux isn’t pronounced with the word ending in an “o” sound.

    I asked it how many “o” there are in Bordeaux it told me there are no o in Bordeaux.

    So, is it counting the sounds made in the word? Or is it counting the letters? Or is it doing none of the above and just giving a probabilistic output based on an existing corpus of language, without any thought or concepts.

  • source
  • hideshow 1 child comment
  • [–] [S] 1 point 1 year ago

    Yes, no, both... and all other interpretations... all at once.

    With any ambiguity in a prompt, it assumes a "blend" of all the possible interpretations, then responds using them all over the place.

    In the case of "Bordeaux":

    It's pronounced "bor-DOH", with the emphasis on the second syllable and a silent "x."

    So... depending on how you squint: there is no "o", no "x", only a "bor" and a "doh", with a "silent x", and ending in an "oh like o".

    Perfectly "logical" 🤷

  • source
  • parent
  • [–] 10 points 1 year ago (1 child)

    Oh wow, I didn't think about how many r sounds. But then if you ask it how many ks are in knight, it should say none.

  • source
  • hideshow 1 child comment
  • [+] 12 points 1 year ago* (last edited 1 year ago) (5 children)
  • [–] 1 point 1 year ago* (last edited 1 year ago) (1 child)

    Wrong maths, you say?

    Yes. If I want to know what 1+2 equals, and I throw a dice, there's a chance I will get the correct answer. If I do, that doesn't mean it knows how to do Maths. Also, notice where it said "Here's the calculation", it didn't actually show you the calculation? e.g. long multiplication, or even grouping, or the way the Chinese do it. Even a broken clock is right twice a day. Even if AI manages to randomly get a correct answer here and there, it still doesn't know how to do Maths (which includes not knowing how to count to begin with)

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (1 reply)
  • [+] [S] -9 points 1 year ago* (last edited 1 year ago) (2 children)

    Those are all the smallest models, and you don't seem to have reasoning mode, or external tooling, enabled?

    LLM ≠ AI system

    It's been known for some time, that LLMs do "vibe math". Internally, they try to come up with an answer that "feels" right... which makes it pretty impressive for them to come anywhere close, within a ±10% error margin.

    Ask people to tell you what a right answer could be, give them 1 second to answer... see how many come that close to the right one.

    A chatbot/AI system on the other hand, will come up with some Python code to do the calculation, then run it. Still can go wrong, but it's way less likely.

    all explanation past the «are you counting the "rr" as a single r?» is babble

    Not so sure about that. It treats r as a word, since it wasn't specified as "r" or single letter. Then it interpretes it as... whatever. Is it the letter, phoneme, font, the programming language R... since it wasn't specified, it assumes "whatever, or a mix of".

    It failed at detecting the ambiguity and communicating it spontaneously, but corrected once that became part of the conversation.

    It's like, in your examples... what do you mean by "by"? "3 by 6" is 36... you meant to "multiply 36"? That's nonsense... 🤷

  • source
  • parent
  • hideshow 2 child comments
  • [–] 6 points 1 year ago

    It just goes to show that the AI is not yet superhuman. If it were really smart it would know, as humans can tell at a glance, that there are four r's in strawberry. There's the first one, the two in the double r combination, and then the rr digram itself which counts as a fourth r.

  • source
  • [–] 5 points 1 year ago (4 children)

    Also ignoring the fact it said one r was in the middle of the word

  • source
  • hideshow 4 child comments
  • [–] [S] 1 point 1 year ago* (last edited 1 year ago) (3 children)

    There is a middle ground between "blindly rejecting" and "blindly believing" whatever an AI says.

    LLMs use tokens. The answer is "correct, in its own way", one just needs to explore why and how much. Turns out, that can also lead to insights.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 1 year ago (2 children)

    It is not correct in any way, though. Unless you count a way you gave it to justify it's wrong answer, but that is just it being a Yes Man to keep you engaged.

  • source
  • parent
  • hideshow 2 child comments
  • [+] [S] 0 points 1 year ago* (2 children)
  • [–] 2 points 1 year ago (1 child)

    It is correct in an “ambiguous multi-dimensional” sense

    That's a lot of words to say it's wrong.

    The question is incredibly straightforward, and again the "reason" it gave is one you provided in the clarifying question itself. There is no reasoning going on, because it can't understand the question (or reason for that matter).

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (-1 replies)
  • load more comments (-1 replies)
  • [–] 6 points 1 year ago (1 child)
  • [–] 2 points 1 year ago

    Kinda remind me of 13yo me, so why not both?

  • source