LLM Gateway

What LLM Gateway is
LLM Gateway provides one OpenAI-compatible API for routing requests across 250+ models from 40+ providers. If a provider errors, times out, or rate-limits a request, it can retry up to twice with another provider for the same model. Its dashboard tracks request, token, spend, latency, error, and cache metrics, broken down by model and provider. Teams can use their own provider API keys without a platform fee and pay providers directly. The open-source core is licensed under AGPLv3 and can be self-hosted for free; enterprise features require a license. Published integration guides cover tools including Claude Code, Cursor, Codex CLI, Cline, n8n, and VS Code. The Free plan costs nothing forever, lists 200+ models across 40+ providers, and includes activity logs and export. It allows 20 requests per minute on free models; paid models are not rate limited. Credit usage has a 5% fee. Enterprise pricing is custom and includes options such as SSO, guardrails, unlimited data retention, and 24/7 priority support. The company states that it is SOC 2 Type II audited and GDPR-aligned, with TLS in transit and AES-256 encryption at rest.
Who it suits
LLM Gateway is aimed at product and platform teams routing model requests through a common API. Its enterprise controls are directed at organizations deploying LLM infrastructure across teams.
What it does well
- Routes requests across 250+ models from 40+ providers.
- Retries failed or limited requests up to twice.
- Dashboard breaks down usage and performance metrics.
- Self-hostable open-source core is free.
- BYOK use has no platform fee.
What to know first
- Free plan limits free models to 20 requests per minute.
- Credit usage on the Free plan has a 5% fee.
- Enterprise features require a license.
- Enterprise pricing is custom and not listed.
Limits
The Free plan costs nothing forever and allows 20 requests per minute on free models; paid models are not rate limited. It also lists a 5% fee on credit usage. Enterprise features require a license and have custom pricing.
Plans
| Plan | Billed and limits | Price |
|---|---|---|
| Free | forever · 200+ models · 40+ providers · free models rate-limited to 20 requests/minute · metadata-only logs · Discord support | Free |
| Enterprise | custom · 30-day trial · all models · custom routing · full payload retention for 30 days · SSO/SAML/OIDC with SCIM · audit logs · guardrails · contractual SLA · 24/7 support | On request |
As llmgateway.io lists them, read 15 Oct 2026. The maker's own page has the final word.
Getting started
- Visit https://llmgateway.io/.
- Choose the Free plan or contact the company about Enterprise.
- Use the OpenAI-compatible API to route requests across providers.
- Optionally self-host the AGPLv3 core.
- Follow a published integration guide for a supported tool.
Verdict
LLM Gateway combines provider routing, retry handling, and usage analytics behind one API. The Free plan includes a credit-usage fee, while enterprise features and pricing are separate considerations for larger deployments.
Questions
What does the Free plan cost?
It is free, billed free forever. Credit usage has a 5% fee.
What is included in the Free plan?
It includes 200+ models across 40+ providers, activity logs and export. Free models are limited to 20 requests per minute; paid models are not rate limited.
Can I self-host LLM Gateway?
Yes. The AGPLv3 open-source core can be self-hosted for free. Enterprise features require a license.
What integrations have guides?
Guides cover Claude Code, Cursor, Codex CLI, Cline, Continue CLI, GitHub Copilot, n8n, OpenCode, and VS Code.
What does Enterprise cost?
Enterprise pricing is custom; the company asks prospective customers to contact them.
What security and identity features are listed for Enterprise?
The company states it is SOC 2 Type II audited and GDPR-aligned, with TLS in transit and AES-256 encryption at rest. Enterprise SSO supports SAML 2.0 and OIDC, with SCIM provisioning and group-based role mapping; guardrails can detect prompt injection, personally identifiable information, and secrets.
Facts from LLM Gateway's own pages
- Analytics
- The dashboard tracks request, token, spend, latency, error, and cache metrics, with breakdowns by model and provider. · llmgateway.io, 7 Oct 2026
- API surface
- Documented endpoints include chat completions, responses, Anthropic messages, embeddings, images, speech, transcription, moderation, search, video and realtime operations. · docs.llmgateway.io, 15 Oct 2026
- Automatic routing
- The gateway selects providers using availability, latency, throughput, price and cache-related signals, with configurable routing behavior. · docs.llmgateway.io, 15 Oct 2026
- BYOK
- Customers may store their own provider keys and use routing and analytics without a platform fee. · llmgateway.io, 15 Oct 2026
- Caching
- Projects can enable response caching to reduce repeated-request latency and token expense. · docs.llmgateway.io, 15 Oct 2026
- Company size
- LinkedIn classifies llm-gateway as a self-employed information-services organization with 2–10 employees. · linkedin.com, 15 Oct 2026
- Credit pricing
- Pay-as-you-go credits use provider list token rates plus a flat 5% fee when credits are purchased; international cards add 1.5%. · llmgateway.io, 15 Oct 2026
- Data retention
- Pricing lists metadata retention as free and full payload retention at $0.01 per 1 million tokens; the Free plan includes activity logs and export. · llmgateway.io, 7 Oct 2026
- Documentation depth
- The documentation includes feature guides, dashboard knowledge-base articles, integration material, self-hosting sections, developer tools and an API reference. · docs.llmgateway.io, 15 Oct 2026
- Enterprise identity
- Enterprise SSO supports SAML 2.0 and OIDC with SCIM provisioning and group-based role mapping. · llmgateway.io, 7 Oct 2026
- Enterprise limits
- Enterprise plans include unlimited seats and unlimited data retention, according to the enterprise page. · llmgateway.io, 7 Oct 2026
- Enterprise pricing
- Enterprise pricing is contact-based and offers volume discounts, custom limits and contractual service levels. · llmgateway.io, 15 Oct 2026
- Failover
- When a provider errors, times out or rate-limits, the gateway can retry on another provider for the same model, up to two times. · llmgateway.io, 15 Oct 2026
- Guardrails
- Enterprise guardrails can detect prompt injection, jailbreak attempts, personally identifying information, payment-card data and secrets, with block, redact or warn actions. · llmgateway.io, 15 Oct 2026
- Identity controls
- Enterprise supports SAML 2.0 or OIDC single sign-on, SCIM provisioning and organization/project roles. · llmgateway.io, 15 Oct 2026
- Independent assessment: API caveat
- GatewayScore reports that latency-based routing applies only to streaming requests and that non-auto tool choices may be downgraded when no mapping supports them. · gatewayscore.com, 15 Oct 2026
- Independent assessment: compliance gap
- GatewayScore says SOC 2 is published but found no unconditional zero-retention guarantee or HIPAA business-associate agreement. · gatewayscore.com, 15 Oct 2026
- Independent assessment: deployment documentation
- GatewayScore found hosted and self-host deployment documented, while VPC, on-premises and air-gapped deployment were not documented on the reviewed pages. · gatewayscore.com, 15 Oct 2026
- Independent assessment: pricing
- Vantaige characterizes the gateway as freemium, with free BYOK and self-hosting and a 5% managed-credit fee. · vantaige.io, 15 Oct 2026
- Independent praise: unified access
- The same Reddit announcement highlights one API, provider fallback and usage/cost tracking as the core benefit for application developers. · reddit.com, 15 Oct 2026
- Independent product description
- A Reddit post by a project builder describes hosted pay-as-you-go access, provider-key mode and AGPLv3 self-hosting, with separate commercial licensing for enterprise code. · reddit.com, 15 Oct 2026
- Independent technical footprint
- Gridinsoft detected React, Next.js, Sonner notifications, Google Cloud hosting and a linked GitHub profile for the site. · gridinsoft.com, 15 Oct 2026
- Independent trust check
- Gridinsoft gave llmgateway.io a 76/100 automated trust score, reporting no major malware or phishing detections and a domain registration date of May 20, 2025. · gridinsoft.com, 15 Oct 2026
- Integrations
- Published integration guides cover Claude Code, Cursor, Cline, n8n, VS Code, Codex CLI, OpenCode, Continue, Kilo Code, Kimi Code and other coding tools. · llmgateway.io, 15 Oct 2026
Where LLM Gateway stands on Freedom251
- LLM gateways#1 of 33
- LLM Gateway Software#2 of 34
- Tool Calling#4 of 21