you are viewing a single comment's thread
view the rest of the comments
[–] 44 points 1 year ago (13 children)

If I asked a PhD, "How many Bs are there in the word 'blueberry'?" They'd call an ambulance for my obvious, severe concussion. They wouldn't answer, "There are three Bs in the word blueberry! I know, it's super tricky!"

  • source
  • hideshow 13 child comments
  • [–] 6 points 1 year ago* (last edited 1 year ago) (2 children)

    I don’t feel this is a good example of why LLMs shouldn’t be treated like PhDs.

    My first interactions with gpt5 have been pretty awful, and I’d test it but it’s not available to me anymore

    Edit: I am not having a stroke, I’m bad at typing and autocorrect hates me

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 1 year ago (4 children)

    FWIW, ChatGPT 5 gets this correct

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 1 year ago (3 children)
  • [–] -5 points 1 year ago (4 children)

    LLMs are fundamentally unsuitable for character counting on account of how they 'see' the world - as a sequence of tokens, which can split words in non-intuitive ways.

    Regular programs already excel at counting characters in words, and LLMs can be used to generate such programs with ease.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 19 points 1 year ago (2 children)

    But they don't recognize their inadequacies, instead spouting confident misinformation

  • source
  • parent
  • hideshow 2 child comments
  • [–] 8 points 1 year ago (1 child)

    This is true. They do not think, because they are next token predictors, not brains.

    Having this in mind, you can still harness a few usable properties from them. Nothing like the kind of hype the techbros and VCs imagine, but a few moderately beneficial use-cases exist.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 1 year ago

    The tokenization is a low-level implementation detail, it shouldn't affect an LLM's ability to do basic reasoning. We don't do arithmetic by counting how many neurons we can feel firing in our brain, we have higher level concepts of numbers, and LLMs are supposed to have something similar. Plus, in the """thinking""" models, you'll see them break up words into individual letters or even write them out in a numbered list, which should break the tokens up into individual letters as well.

  • source
  • parent