octo
llama
one master · many AI hosts · one home network
📱💻 You
browser → panel
http://master:5000
VS Code · chat
Continue.dev, Open WebUI,
any OpenAI-compatible app
MASTER — management host
Web panel
:5000 · login
LiteLLM
:4000 · gateway
Ollama
:11434 · models
Root daemon
state.json · 0 ports
NFS server
state per host
Open WebUI
chat → LiteLLM
SLAVE 1 · mini-PC
Ollama
daemon
state over NFS · 7B models
SLAVE 2 · BC-250
Ollama
daemon
state over NFS · 14B models
💤
SLAVE 3 · laptop
Ollama
daemon
state over NFS · embeddings
⚠️
…and more hosts
octo
llama
Get it for free · open source · GPL-3.0
github.com/cyryllo/OctoLlama