Best LLM Gateway Software in 2026
Updated
33ranked
2free plans on this page
$20/molowest paid tier
8 Oct 2026last checked
2 of the 8 here have a free tier you can use, 0 have open-source code on record, and 0 have full bars: free, open, on most of your devices and documented.
| # | App | Signal | Free tier | Open code | Devices | From | Score |
|---|---|---|---|---|---|---|---|
| 26 | OpenZiti LLM GatewayWindows · Mac · Linux | One bar | — | — | 3 of 6 | — | 5.3 |
| 27 | Cloudflare AI GatewayWeb | No signal | — | — | 1 of 6 | — | 5.2 |
| 28 | CortecsWeb | No signal | — | — | 1 of 6 | — | 5.2 |
| 29 | vLLM Semantic RouterMac · Linux | No signal | — | — | 2 of 6 | — | 5.2 |
| 30 | ZenMuxWeb · API | One bar | — | 1 of 6 | $20/mo | 5.2 | |
| 31 | Envoy AI GatewayMac · Linux · Self-hosted · API | One bar | — | 2 of 6 | Free | 5.1 | |
| 32 | Kong AI GatewayWeb | One bar | — | — | 1 of 6 | — | 4.9 |
| 33 | Ramp RouterWeb | No signal | — | — | 1 of 6 | — | 4.8 |
Compare all 8 in a table
| # | App | Score | Free plan | From | Free plan | Paid from | Provider count | Fallback routing |
|---|---|---|---|---|---|---|---|---|
| 26 | OpenZiti LLM Gateway | 5.3 | No | — | — | — | — | Yes |
| 27 | Cloudflare AI Gateway | 5.2 | No | — | Yes | — | — | Yes |
| 28 | Cortecs | 5.2 | No | — | — | — | 10 | Yes |
| 29 | vLLM Semantic Router | 5.2 | No | — | Yes | — | — | No |
| 30 | ZenMux | 5.2 | Free plan | $20/mo | Yes | 20 /mo | — | Yes |
| 31 | Envoy AI Gateway | 5.1 | Free plan | Free | Yes | — | — | Yes |
| 32 | Kong AI Gateway | 4.9 | No | — | No | — | — | Yes |
| 33 | Ramp Router | 4.8 | No | — | No | — | — | Yes |
More in Developer Tools
All developer tools listsAccessibility Testing Software 168Log Management Software 107AI Coding Assistants 103Package Managers 93AI Agent Platforms 73Reverse Engineering Tools 73Software Composition Analysis Software 66Artifact repository software 64Browser Automation Tools 63Integrated Development Environments 63Code Playground Software 58Container Registries 56