you are viewing a single comment's thread
view the rest of the comments
[–] 26 points 2 days ago (4 children)

It's always "amusing" how domain-specific experts consistently declare that LLM's emit meaningless slop in their field, but seldom questions whether that might be the case for everything else too.

Narrator: It was.

  • source
  • hideshow 4 child comments
  • [–] 10 points 1 day ago* (1 child)

    *Briefly stated, the Gell-Mann Amnesia effect works as follows. You open the newspaper to an article on some subject you know well. In Murray's case, physics. In mine, show business. You read the article and see the journalist has absolutely no understanding of either the facts or the issues. Often, the article is so wrong it actually presents the story backward-reversing cause and effect. I call these the "wet streets cause rain" stories. Paper's full of them.

    In any case, you read with exasperation or amusement the multiple errors in a story-and then turn the page to national or international affairs, and read with renewed interest as if the rest of the newspaper was somehow more accurate about far-off Palestine than it was about the story you just read. You turn the page, and forget what you know. *

    Michael Crichton

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 1 day ago (1 child)

    Sometimes its just that they only feel qualified to comment on thier own domain... But yeah, the same assumption has existing with science reporting even before LLMs...

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 1 day ago*

    We don't even have to get that specialized, really. I mean, I must've had dozens of conversations with people over the years about how "some newspaper article was clearly full of shit" advanced by people either involved in the reported proceedings or domain-specific specialists knowledgeable about the topic. And yet, they all presumed the rest of the same issue was somehow more accurate than what they knew to be factually wrong.

    It's the same with LLMs, just on steroids.

  • source
  • parent