Skip to main content
View as Markdown

Run Sovrium AI locally with Ollama

You want Sovrium's AI features — AI fields, agents, RAG — to run on a model you host yourself, with no data leaving your server and no per-token bill.

Point Sovrium at Ollama

Install and start Ollama, pull a model, then set the provider:

>_ terminal
ollama pull llama3.1
export AI_PROVIDER=ollama
export OLLAMA_BASE_URL=http://localhost:11434
sovrium start app.ts

Local-first is the default posture — Sovrium routes AI calls through Ollama with no API key. Swap AI_PROVIDER to a cloud provider later without touching your config.

Verify

Trigger any AI field or agent in your app; the request is served by your local model. With no provider configured, AI features boot inert rather than failing.

Next

  • AI Overview — the AI fields, agents, and RAG that use this provider.
  • AI Providers — the full provider precedence and cloud options.
  • AI Eco Routing — the local-first routing that keeps inference on your hardware.

Last updated September 1, 2026

This documentation was written with AI, so errors or outdated content are possible. Sovrium is in beta. Contributions and corrections are welcome.

Built with Sovrium