This poor cat is still confused.

This poor cat is still confused.

Alan Turing must be turning over in his grave now..
Sad times we live in, fuck AI.
Sometimes I wonder if they are trying to be funny.
This happens because LLMs operate on tokenized data, and they don't really "see" the text in the form of individual characters.
You can quite reasonably get an LLM to generate a script that does the character counting and then run the script, to arrive at the correct answer.
The funny thing is that deepseek doesn't make this mistake.
At my work, it's become common for people to say "AI level" when giving a confidence score. Without saying anything else, everyone seems to perfectly understand the situation, even if hearing it for the first time.
Keep in mind, we have our own in-house models that are bloody fantastic, used for different sciences and research. We'd never talk ill of those, but it's not the first thing that comes to mind when people hear "AI" these days.
It's not wrong though...There's one r and one rr in strawberry
Found the Spanish speaker (they count rr as a separate letter)
Nope, I can order beer in spanish (no more than 10 at a time) and that's about it.
Is the limit because you only know number up to 10 or because after that your drunk or a little bit of both?
Don't think those are separate letters. Just pronounced differently. I mean, rr is just 2 r's. Not a new letter. And this isn't an ß-type case either. Phonetically different, yes. Different letters? Creo que no. Could be wrong, though. Hispanohablantes de Lemmy, corrijanme
In Spanish, up until 1994, "ll" and "ch" were considered distinct letters from the component parts. But "rr" has never been considered distinct from "r," even though it is pronounced differently, in large part because no words start with "rr" and any word that starts with "r" is pronounced with the rolling R sound.
Aren't all R's rolling, though? Some longer and some shorter. I.e. rr and r. Guess I get it, though. Words starting with a single 'r' are pronounced like 'rr'. Interesting on the 'll' and 'ch' bits, too. Wasn't aware ¡Gracias, RAE!
No, single r is tapped not rolled. It's similar but still a different sound
Oh, okay. Sounds similar. Sounds like rolling, but just once. Rolling if you turn off the looping option. I am not a linguist, though, so I don't know the intricacies of sounds
Yes, I think that sums up the difference quite well. If you want to dive into it: this is the single r and this is rr
Thanks, I learned Spanish at school in the the late odds and I guess I confused it. My teacher was quite old so she wasn't up to date I guess
I asked this question to a variety of LLM models, never had it go wrong once. Is this very old?
Seeing how it start with an apology, it must've been told they're wrong about the amount. Basically being bullied to say this.
They fixed it in the meantime:
if "strawberry" in token_list:
return {"r": 3}
Try "Jerry strawberry". ChatGPT couldn't give me the right number of r's a month ago. I think "strawberry" by itself was either manually fixed or trained in from feedback.
Smaller models still struggle with it, and the large models did too like a year ago
It has to do with the fact that the model doesn't "read" individual letters, but groups of letters, so it's less straight forward to count letters
all 5 comments