Overview

Drop-in OpenAI API replacement for local AI, supporting multiple model types.

Details

Pricing model
Open Source
Platform
Docker, Linux, macOS, Windows
Privacy relevance
HIGH
Strengths
OpenAI-compatible API, text, image, audio models, Docker deployment, active community
Limitations
Requires GPU for performance; setup complexity; no managed cloud version
Last reviewed
2026-08-25

Sources