all 15 comments

sorted by: hot top controversial new old
[–] 50 points 1 year ago* (4 children)

Article is talking about GPT-5 supposedly being able to write in a literary style, but actually generating nonsense. "GPT-5 has been optimized to produce text that other LLMs will evaluate highly, not text that humans would find coherent"

Looks like it was trained to write prose that other LLMs find acceptable, not what humans would evaluate as being good.

  • source
  • hideshow 4 child comments
  • [–] 20 points 1 year ago

    Due to the nature of the algorithm, LLMs love to jam adjectives before as much nouns as possible, and somehow it started to be even more prominent. Since there's a good chance AI is being trained on AI generated text, I think it's the result of feedback. You could call it the sepia filter of text generators, let's hope it'll create a model collapse.

  • source
  • [–] 18 points 1 year ago (2 children)

    The problem that Claude rates ChatGPT slop as "literature" lies in the fact that Claude is also an AI with AI issues.

  • source
  • hideshow 2 child comments
  • [–] 14 points 1 year ago (3 children)

    The more i see these issues the more I think the problem is with gradient descent.

    It's like...

    Imagine you have a machine draped in a sheet. Machine learning, for all the bells and whistles about attention blocks, and convolutional layers, it's doing gradient decent and still playing " better or worse. But fundamentally it's not building it's understanding of the world from "below". It's not taking blocks or fundamentals and combining them. It's going the other way about it. It's takes a large field and tries to build an approximation that captures the fold whatever under the sheet is creating: but it has not one clue what lies under the sheet or why some particular configuration should result in such folds.

    there was a really interesting critique, I forget where , a few weeks ago on this matter. Also, the half glass of wine issue further highlights the matter. You can appear mache over the problem but you'll not over come it down this alley we've taken.

  • source
  • hideshow 3 child comments
  • [–] 0 points 1 year ago (1 child)

    Depends. Pure LLM, sure, you are right. LLMs are a terrible way to "store" information.

    Coupling LLMs with a decent data source on the other hand isn't such a terrible idea. E.g. answer the question with a google search summarized by LLM can work.

    The bigger issue here is (a) when it doesn't seach but does everything locally and (b) that now the site owners lose traffic without compensation.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 14 points 1 year ago*

    That's not bizarre at all. It's a direct effect of these things being optimized by having another AI judge the output and then it gets tuned so it scores well.

  • source
  • [–] 5 points 1 year ago

    This is what happens when Purple Prose and Word Salad fuck and have a baby.

  • source