I keep a lot of notes in markdown files, and I'd like an LLM to assist.

I regularly use Open WebUI with with inference routed through huggingface. Open WebUI kind of has this functionality like you can upload a markdown file and prompt it to improve it in whatever way, but of course that's a fairly clunky workflow.

I really want something built into the editor, that can use RAG to consider other files in context.

I also don't want to be locked in to a specific LLM or provider, I'd like to be able to link it to OpenRouter or similar.

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 6 months ago

Koboldcpp has a pretty easy way to add a text db built right into it. You can use any model you want, and its pretty customizable.

  • source