431
I'm tired of LLM bullshitting. So I fixed it. (codeberg.org)
submitted 9 months ago by to c/privacy@lemmy.ml
87 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 22 points 9 months ago (3 children)

I’m probably going to give this a try, but I think you should make it clearer for those who aren’t going to dig through the code that it’s still LLMs all the way down and can still have issues - it’s just there are LLMs double-checking other LLMs work to try to find those issues. There are still no guarantees since it’s still all LLMs.

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
  • [–] 10 points 9 months ago (2 children)

    I haven’t tried this tool specifically, but I do on occasion ask both Gemini and ChatGPT’s search-connected models to cite sources when claiming stuff and it doesn’t seem to even slightly stop them bullshitting and claiming a source says something that it doesn’t.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [+] [S] 4 points 9 months ago* (last edited 6 months ago) (2 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 9 months ago* (1 child)

    How does having a key solve anything? Its not that the source doesn’t exist, it’s that the source says something different to the LLM’s interpretation of it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [+] [S] 10 points 9 months ago* (last edited 6 months ago) (1 child)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 9 months ago

    The hash proves which bytes the answer was grounded in, should I ever want to check it. If the model misreads or misinterprets, you can point to the source and say “the mistake is here, not in my memory of what the source was.”.

    Eh. This reads very much like your headline is massively over-promising clickbait. If your fix for an LLM bullshitting is that you have to check all its sources then you haven’t fixed LLM bullshitting

    If it does that more than twice, straight in the bin. I have zero chill any more.

    That’s… not how any of this works…

  • permalink
  • fedilink
  • source
  • parent
    • load more comments (-1 replies)
    • load more comments (-1 replies)