Conducting deep web searches and gathering sources is one of the main things I've been using LLMs for. How far away are we from being able to self-host something like Claude's web search capabilities? Or even just a service where I'd pay with my money instead of my data?

you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 4 months ago* (13 children)

Openwebui+searxng on a AMD strix board.

Pro: works like a charm, low power consumption, fast, "big" , LLM (running qwen3.6 35B A3B + gemma4 E4B for website summaries and other smaller tasks)

Con: strix boards start at 2k€, more in USA because of tarrifs

  • source
  • hideshow 13 child comments
  • [–] 2 points 4 months ago (1 child)

    Yup. And if you want to take a small step without major hardware requirements: connect your setup to a paid subscription Mistral or Anthropic API. They allow you to switch off training on your data.

    On top of that, the costs are way lower than the normal consumer grade chat subscriptions, and your searches + memory are kept locally (e.g., managed through open webui).

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (11 replies)