18
Deep Researcher web app based on Node.js OS (MIT) (lemmy.ml)
submitted 1 year ago by to c/opensource@lemmy.ml
8 comments fedilink hide all child comments
 

I made a node.js-based "Deep Researcher" web app. It searches internet and creates structured academic-style cited reports based on user's prompt. One can nudge the app to search exclusively through scholar sources with science-related keywords.

The app requires your own api key to run OpenAI's LLMs and the web search tool. The LLM vendor can easily be changed. The search will be changed to "Tavily" if the corresponding api key is provided

Edit: added web search tool.
Edit-2: added a sentence about "Tavily"

Edit 3: My public board for tracking progress

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 4 points 1 year ago (2 children)

No, not without substantial code update. But it is a good idea to break a vendor lock.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 1 year ago (1 child)

    How did you design this in a way that it would require a "substantial update" to swap out the API URL? It should be as easy as setting an environmental variable. There are many LLM providers and local LLMs that support the openAI API schema.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] [S] 1 point 1 year ago* (last edited 1 year ago)

    I meant that I use OpenAI's web_search tool for the app, changing that is not difficult but would require testing after he fact. Changing LLMs for summarizers, outliners and final report is just few lines of code, especially if the providers use OpenAI formate, and should be easy also test-wise.

    I am now working on implementing "tavily" search tool in addition to web_search by OpenAI. The app will default to "tavily" when valid api key is provided by the client.

  • permalink
  • fedilink
  • source
  • parent