Skip to main content
View as Markdown

Run Sovrium AI locally with Ollama

You want Sovrium's AI features — AI fields, agents, RAG — to run on a model you host yourself, with no data leaving your server and no per-token bill.

Point Sovrium at Ollama

Install and start Ollama, pull a model, then set the provider:

ollama pull llama3.2
export AI_PROVIDER=ollama
export OLLAMA_BASE_URL=http://localhost:11434
sovrium start app.ts

Local-first is the default posture — Sovrium routes AI calls through Ollama with no API key. Swap AI_PROVIDER to a cloud provider later without touching your config.

Verify

Trigger any AI field or agent in your app; the request is served by your local model. With no provider configured, AI features boot inert rather than failing.

Next

  • AI Overview — the AI fields, agents, and RAG that use this provider.
  • AI Providers — the full provider precedence and cloud options.
  • AI Eco Routing — the local-first routing that keeps inference on your hardware.

Last updated July 21, 2026

This documentation was written with Claude Fable 5 (Anthropic), so errors or outdated content are possible. Sovrium is in beta — contributions and corrections are welcome.

Built with Sovrium