- Ollama
- OpenAI
- Anthropic
- Gemini
- OpenRouter
Fully offline — no API key leaves your machine. Any OpenAI-compatible local runner works the same way (LM Studio, vLLM, llama.cpp server); this is the Ollama version.
.env
gpt-oss:20b is a good default for a laptop-class GPU. Bigger models work if you have the VRAM — set OPENAI_MODEL to whatever you’ve pulled.