Just had a quick look - while they have that self-hosting option, they still assume you will use a cloud LLM. I started digging because I got confused of them not mentioning any GPU when it comes to resource requirements. There is some documentation on using it fully self-hosted including the LLM, but the emphasis here is on "some".

To be clear: I am looking at this from a CEO perspective, not a "I will play with it in my spare time" nerd one.

Going off on a tangent here but, does anyone have a good guide on how to set up an AI/LLM/GPT chatbot/agent for a small business?

Not looking to spend millions but a couple thousand are alright. TIA

Open-webui works well for us: https://github.com/open-webui/open-webui

u/tinodb, thanks

Hmm I thought this would be a competitive space already i.e. integrating llm chat bots on any website