Skip to content

Homelab update: extending the local AI stack

After setting up a local RAG pipeline with Flowise, I have now added Open WebUI, connected to Ollama and extended with the Brave Search API for live web search.

Watch the demo

Watch the video

What is Open WebUI?

Open WebUI is a front end for locally hosted LLMs. It supports interaction with models, the parallel management of several configurations, and extension through tools and functions.

What is the Brave Search API?

The Brave Search API provides the web search capability in Open WebUI, allowing the local model to incorporate current information from the web. Inference remains local; only the search queries are transmitted externally.

The resulting configuration is self-hosted apart from the search queries sent to the Brave API, combining local inference with live web search.