AI & automation
Open WebUI
Chat front-end for whichever LLM backend LiteLLM is routing to
What it does
Open WebUI is a ChatGPT-style web interface for talking to language models, keeping chat history and settings instead of a bare API call.
How it runs here
Runs in the open-webui namespace behind Traefik on ai.kei-space.com, with chat history in its own PostgreSQL database and sign-in offered through Keycloak over OpenID Connect. It talks to LiteLLM's in-cluster service as its OpenAI-compatible backend, authenticating with a key from the same secret LiteLLM itself reads.
Connects to
Why I chose it
Pointing the chat UI at LiteLLM instead of a single provider means the model backend can change without reconfiguring the UI.