Use own openai compatible

Feature Request wmek wmek · 10 months ago · edited

We'd like to use our own openai compatible endpoint instead of the openai.com offical api.

Why?
Self-hosting is a main reason why clients choose us. Not being able to also use our own self-hosted llms or eu-datacenter llms is a big minus and not "Privacy-first solution
" as stated on the website ;)

also, this is very easy to implement. all you need is to not hardcode the openai api endpoint, instead allow us to pass our own, openai compatible endpoint. that's it.

Micah Micah · 8 months ago (edited)

Exactly! Very easy feature to add, and would be super appreciated!

Log in to reply

Voters (3)

Dima Botezatu Dima Botezatu
wmek wmek
Micah Micah