you are viewing a single comment's thread
view the rest of the comments
[–] 32 points 6 months ago (3 children)

Yes, and I actually use it to train a local llm so I'm not hammering the internet. I have a ton of storage, and like to keep my kids in the sandbox, so we have wikipedia, project gutenberg, kahn academy, and a bunch of others all hosted behind an apache reverse proxy which is using mellon so there's LDAP auth.

  • source
  • hideshow 3 child comments
  • [–] 4 points 6 months ago (1 child)

    Do you actually train the LLM or use RAG? I have been looking for a local LLM + Wikipedia RAG solution for a while now.

    For now I just have kiwix-serve + searxng doing a simple search but the Kiwix search is...questionable.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (-1 replies)