They got to him

you are viewing a single comment's thread
view the rest of the comments
[–] 24 points 1 month ago (3 children)

This happens when an LLM reads a bunch of pages with stuff it doesn't have much internal knowledge about, and then tries to summarize that into an article.

LLMs do not have knowledge about anything.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -1 points 1 month ago (2 children)

    Books contain knowledge, I doubt you will find many English scholars that disagree with that. In the same way, LLMs contain knowledge as well, they just also have the ability to output that knowledge in a more dynamic way than a book. You can argue some words that are more anthropomorphic, but knowledge has been attributed to inanimate objects for millennia.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 month ago (1 child)

    No, LLMs only contain a bunch of numbers that predict which word is likely to follow the previous ones. Their output resembles knowledge simply because the most likely combination of words is one meant to convey information.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 0 points 1 month ago

    And books just contain a series of words. You are playing semantics games. An ebook is just a bunch of electrons shoved into a rock. Yet, somehow, it also contains knowledge.

    In a less abstract way, LLMs giant relational databases that are expressed by using the relationship between previous words to select a word that might follow. It's in the relational graph that the knowledge is stored. The information is there, and the way we've figured out best to get it out is by generating tokens.

  • source
  • parent