you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 7 months ago (7 children)
  • [–] 7 points 7 months ago (3 children)

    It's a chat bot that googles your question before answering in the hopes to cut down on hallucinations. It doesn't solve this problem at all.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 7 months ago* (1 child)

    I don't think it will make enough difference, but RAG stands for Retrieval Augmented Generation.

    There's a few ways to do it, but basically it's a way add extra information to the conversation. By default the model only knows what it generates, plus what is in the conversation. RAG adds extra information to the mix.

    The simplest approach is to scan the conversation for keywords and add information based on them.

    So you ask "what is the capital of France" and instead of the model answering/hallucinating by itself, your app could send the full Wikipedia page for France along with your question, and the model will almost always return the correct answer from the Wikipedia page and hallucinate much less. In practice it gets a lot more complicated and I'm not up to date on recent RAG but the idea is the same.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 7 months ago

    the model will almost always return the correct answer from the Wikipedia page and hallucinate much less

    Ah, so much better than our current systems the use significantly fewer resources for consistently correct answers.

  • source
  • parent
  • load more comments (1 reply)