Levi Huff
← Infrastructure

Local LLM stack

Role Built and operate

Status Running

Ollama Open WebUI Docker

Self-hosted LLM inference with Ollama and Open WebUI, deployed with Docker. Same discipline as the rest of the homelab: containerized, documented, monitored.

Function
Local model inference and a web front end for experimenting with models without sending data to third-party services.