Run Sovrium AI locally with Ollama
You want Sovrium's AI features — AI fields, agents, RAG — to run on a model you host yourself, with no data leaving your server and no per-token bill.
Point Sovrium at Ollama
Install and start Ollama, pull a model, then set the provider:
ollama pull llama3.2
export AI_PROVIDER=ollama
export OLLAMA_BASE_URL=http://localhost:11434
sovrium start app.ts
Local-first is the default posture — Sovrium routes AI calls through Ollama with no API key. Swap AI_PROVIDER to a cloud provider later without touching your config.
Verify
Trigger any AI field or agent in your app; the request is served by your local model. With no provider configured, AI features boot inert rather than failing.
Next
- AI Overview — the AI fields, agents, and RAG that use this provider.
- AI Providers — the full provider precedence and cloud options.
- AI Eco Routing — the local-first routing that keeps inference on your hardware.
Last updated July 21, 2026
This documentation was written with Claude Fable 5 (Anthropic), so errors or outdated content are possible. Sovrium is in beta — contributions and corrections are welcome.