How did you design this in a way that it would require a "substantial update" to swap out the API URL? It should be as easy as setting an environmental variable. There are many LLM providers and local LLMs that support the openAI API schema.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies: