Side by side
Envoy AI Gateway vs LiteLLM
Both stand on llm gateway software. Which one you can start free with, which one lets you read the code, and what each costs once you pay.
Agent Router provides a unified interface and traffic controls for teams managing AI models and tools. Local use and Kubernetes production deployment have different requirements, so check the listed compatibility versions before deployment.
Visit Envoy AI GatewayChoose LiteLLM if your platform team needs a shared gateway for many providers, with routing and spend controls. The free plan covers self-hosted gateway features; teams needing Enterprise access controls, audit logs, or dedicated support should consider Enterprise, whose price is sized to usage.
Visit LiteLLMThe facts
| Envoy AI Gateway | LiteLLM | |
|---|---|---|
| Free plan | Yes | Yes |
| Open source | Not published | Not published |
| Runs on | API, Linux, Mac, Self-hosted | API, Self-hosted, Web |
| Lowest paid plan | Free or on request | Free or on request |
| Plans published | 1 | 2 |
| Maker | Not published | Not published |
| Website | aigateway.envoyproxy.io | litellm.ai |
| On llm gateway software | #5 of 34 | #9 of 34 |
Envoy AI Gateway: what it does well
- OpenAI-compatible API for models and MCP servers
- Includes provider failover and token quotas
- MCP gateway supports OAuth authentication
- Apache 2.0 licensed
- Supports local and Kubernetes deployment
What to know first
- Local CLI currently supports only Linux and macOS
- Kubernetes deployment requires compatible dependencies
LiteLLM: what it does well
- One OpenAI-compatible API for 140+ providers and 1,800+ models.
- Routes requests by load balance, cost, or prompt simplicity.
- Tracks spend across keys, users, teams, and other entities.
- Supports hard budgets, rate limits, and fallback routing.
- Can be self-hosted, including in air-gapped environments.
What to know first
- The free Open Source plan is self-hosted.
- Enterprise pricing is sized to usage and has no listed price.
Alternatives to Envoy AI Gateway Alternatives to LiteLLM The whole list
