Free and open first
Best LLM gateways in 2026
This list covers LLM gateway software for API, web, or self-hosted setups. It includes tools that run on Linux, macOS, or Windows.
- 33 apps
- Research read 16 Oct 2026
- How the order is worked out
- 1
LLM Gateway
Free plan Open source APIExtensionLinux+2LLM Gateway combines provider routing, retry handling, and usage analytics behind one API.
- 2
Manifest
Free plan Open source APILinuxSelf-hosted+1Manifest offers both cloud and self-hosted gateway options, with routing, fallback, repair, and spending visibility.
- 3
Bifrost
Free plan Open source APILinuxMac+3Bifrost brings provider access, traffic controls, and observability into one gateway, with a free self-hosted OSS edition.
- 4
YoloRouter
Free plan Open source APILinuxMac+3YoloRouter centralizes requests across supported model providers and includes controls for routing, access, and usage.
- 5
Kong Gateway
Free plan APILinuxSelf-hosted+1Choose Kong Gateway if you need an API gateway with open-source availability and deployment options spanning on-premises, cloud, Kubernetes, and serverless environments.
- 6
TensorZero
Free plan APILinuxSelf-hosted+1TensorZero brings gateway, observability, and experimentation capabilities together in a self-hosted, open-source stack.
- 7
Envoy AI Gateway
Free plan APILinuxMac+1Agent Router provides a unified interface and traffic controls for teams managing AI models and tools.
- 8
LangSmith
Free plan APILinuxMac+3LangSmith combines agent evaluation with prompt tools and observability, including cost and trajectory tracking.
- 9
Helicone
Free plan APISelf-hostedWebHelicone brings routing and observability tools together, with a free tier and self-hosting options. Its maintenance-mode status is worth weighing when considering it for a new deployment.
- 10
Routerly
Free plan APILinuxMac+3Routerly brings provider routing, cost tracking, and budget controls into a self-hosted gateway. It is free under AGPL-3.0 and adds no markup to API calls.
- 11
LiteLLM
Free plan APISelf-hostedWebChoose LiteLLM if your platform team needs a shared gateway for many providers, with routing and spend controls.
- 12
Orq.ai
Free plan APISelf-hostedWebChoose Orq.ai if your team needs a gateway to route and govern model requests while tracking costs and usage.
7.3 Visit site - 13
Polyrouter
Free plan APISelf-hostedWebChoose Polyrouter if you need one endpoint for multiple model providers and want routing, fallback, and budget controls in a free, self-hosted gateway.
- 14
SGLang
Free plan APILinuxMac+1SGLang combines model serving, multiple inference optimizations, and broad hardware support in a free framework.
- 15
TrueFoundry AI Gateway
Free plan APILinuxSelf-hosted+1Choose TrueFoundry AI Gateway if your team needs centralized model access, routing and usage controls across providers.
- 16
OpenRouter
Free plan APIWebOpenRouter brings model access, routing and integrations together behind a single endpoint. The Free plan has a daily request cap, while pay-as-you-go plans apply platform fees to credit purchases.
- 17
Requesty
Free plan APIExtensionWebRequesty combines model access, routing, usage analytics and governance in a managed gateway. Check its logging defaults and pricing structure against your needs before choosing a plan.
- 18
Tyk AI Studio Proxy
Free plan APISelf-hostedWebTyk AI Studio Proxy combines routing, guardrails, and usage governance in a self-hostable Community Edition.
- 19
UniterRouter
Free plan APIWebUniterRouter brings model access, routing, and usage analytics together behind an OpenAI-format API. The free plan offers $5 in credits, while Pro costs $50 a month and Enterprise pricing is custom.
- 20
WSO2 AI Gateway
Free plan APILinuxMac+3WSO2 AI Gateway combines provider access, policy controls, analytics and MCP governance in one gateway.
- 21
- 22
ZenMux
Free plan APIWebZenMux combines multi-provider model access with routing, failover, and usage analytics.
- 23
Ramp Router
Free plan APIWebRamp Router combines cross-provider model access with routing, fallbacks, and request-level usage tracking.
6.9 Visit site - 24
Inference Gateway
Free plan APILinuxMac+3Inference Gateway centralizes provider access, routing, MCP tools, and agent workflows behind one API. It is free, open source, and deployable through Docker, Kubernetes, or self-hosted environments.
- 25
Apache APISIX
Free plan APILinuxSelf-hostedAPISIX combines API and AI gateway functions with broad protocol and plugin support. Its self-managed model and separate commercial support are important considerations for teams evaluating it.
#1Places #1, #2, #3, #4, #5 on this list can be bought by the makers of the software on it. See the price
Compare the free plan, trial length, paid pricing, licence, and supported platform before choosing. If you need to read or change code, check the tool's open-source licence.
Questions
Do LLM gateways have free plans?
Yes. Free plans are listed for tools including LLM Gateway, Manifest, TensorZero, Kong Gateway, Bifrost, Helicone, LangSmith, LiteLLM, OpenRouter, and Envoy AI Gateway.
Which gateways offer free trials?
LLM Gateway and LiteLLM list 30-day trials. Bifrost lists a 14-day trial, and Helicone lists a seven-day trial.
Are any LLM gateways open source?
Open-source code is offered by tools on this list. Check the licence for the tool you plan to use.
Can I self-host an LLM gateway?
Self-hosted options are available. Orq.ai is listed for self-hosted use, alongside API and web access.
What platforms do these tools support?
The list includes API, web, self-hosted, Linux, macOS, and Windows options. Check the platform details for the tool you are considering.
More in AI Tools
- Model registries38
- AI Drug Discovery Software33
- Agentic AI Browser Software18
- Agentic Analytics Software22
- AI Afrobeats Music Generators26
- AI Agent Security Software31
- AI Agents for Customer Support Software27
- AI Agents for HR Software24
- AI Background Music Generators29
- AI Backing Track Generators16
- AI Birthday Song Generators31
- AI Camera Motion Video Tools19