TrueFoundry AI Gateway

Free plan APILinuxSelf-hostedWeb

Visit TrueFoundry AI Gateway Alternatives Pricing

What TrueFoundry AI Gateway is

TrueFoundry AI Gateway gives applications a single API for accessing and managing AI models. It supports chat, completion, embedding and reranking models, and TrueFoundry says it connects to more than 1,000 LLMs across more than 35 platforms, including OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI and Anthropic. Routing options include latency-based selection, weighted load balancing and fallback to secondary models. The gateway records token use, latency, errors and request volumes, and can store request and response logs centrally. Teams can set rate limits and cost or token quotas, then manage access with role-based controls. It also connects tools such as Slack, GitHub, Confluence and Datadog through MCP, with OAuth2, role-based access and metadata policies for tool calls. Safety controls include PII filtering and toxicity detection. The service is offered as SaaS; Enterprise adds VPC, on-premises and air-gapped deployment options. TrueFoundry says those deployment environments can keep sensitive data within enterprise boundaries. Developer is free, Pro costs $25 per user per month, and Enterprise uses custom pricing. Supported platforms include API, self-hosted and web.

Who it suits

It suits teams that need one interface to connect applications to multiple model providers, with routing, usage tracking and access controls. Teams with enterprise deployment or advanced support needs can consider the Enterprise plan.

What it does well

One API supports chat, completion, embedding and reranking models.
Routing includes latency selection, weighted balancing and secondary-model fallbacks.
Tracks token use, latency, errors and request volumes.
Usage controls include rate limits, quotas and role-based access.
Enterprise offers VPC, on-premises and air-gapped deployment.

What to know first

The free Developer plan is limited to three users and five model accounts.
Pro charges $20 per additional 100,000 requests beyond its included quota.
Enterprise pricing is custom.

Limits

Developer is free for up to three users and includes 10,000 requests per user per month, five model accounts and five MCP servers. Pro costs $25 per user per month and includes 20,000 requests per user per month; additional requests cost $20 per 100,000. Built-in guardrails are listed for Pro, while Enterprise also includes custom and third-party guardrails.

Plans

Plan	Billed and limits	Price
Developer	Free · 3 users · universal API · model RBAC · virtual and self-hosted models · playground	Free
TrueFoundry Enterprise (AWS Marketplace)	1-month contract · Enterprise AI Gateway plan · additional AWS infrastructure costs may apply	$12,500 a month
TrueFoundry On-Prem (AWS Marketplace)	1-month contract · On-premises AI Gateway plan · additional AWS infrastructure costs may apply	$16,666.66 a month
Pro Plus	$2,999/month · 25 users · SSO · GDPR and HIPAA certificates · VPC and air-gapped deployment · data-lake export	$2,999 a month
Pro	$499/month · 10 users · 1M monthly requests · configurable routing · rate limiting · up to 25 MCP servers	$499 a month
TrueFoundry Pro (AWS Marketplace)	1-month contract · Enterprise AI Gateway plan · additional AWS infrastructure costs may apply	$6,250 a month
Enterprise	Contact Us · 10M+ monthly requests · dedicated onboarding · enterprise SLAs	On request

As truefoundry.com lists them, read 15 Oct 2026. The maker's own page has the final word.

Getting started

Open the TrueFoundry AI Gateway website.
Choose the free Developer plan or review Pro and Enterprise options.
Use the API or web platform, or choose self-hosted deployment.
For Enterprise, review VPC, on-premises and air-gapped deployment options.

Verdict

Choose TrueFoundry AI Gateway if your team needs centralized model access, routing and usage controls across providers. The free Developer plan has user, request, model-account and MCP-server caps; teams needing advanced security, deployment choices or support should review Enterprise, whose price is custom.

Questions

Is TrueFoundry AI Gateway free?

Yes. Developer is free for up to three users, with 10,000 requests per user per month, five model accounts and five MCP servers.

How much does Pro cost?

Pro costs $25 per user per month. It includes 20,000 requests per user per month, with additional requests priced at $20 per 100,000.

Which platforms does it support?

The listed platforms are API, self-hosted and web. SaaS is available, and Enterprise lists VPC, on-premises and air-gapped deployment.

Which model providers does it connect to?

TrueFoundry says it connects to more than 1,000 LLMs across more than 35 platforms, including OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI and Anthropic.

Does it support tool integrations?

Yes. MCP connections include Slack, GitHub, Confluence and Datadog, with OAuth2, role-based access and metadata policies for tool calls.

Who makes TrueFoundry AI Gateway?

TrueFoundry lists its company address as Ensemble Labs Inc in San Francisco. It says the company was founded in 2021 by Nikunj Bajaj, Abhishek Choudhary and Anuraag Gutgutia.

Facts from TrueFoundry AI Gateway's own pages

Access controls: Teams can apply rate limits and cost or token quotas and use role-based access control to manage usage. · truefoundry.com, 4 Oct 2026
API authentication: The metrics API accepts Personal Access Tokens or admin-created Virtual Account Tokens. · truefoundry.com, 15 Oct 2026
API surface: The documentation exposes endpoints for chat, embeddings, reranking, responses, images, audio, batches, files, fine-tuning, moderation and model listing. · truefoundry.com, 15 Oct 2026
Company: TrueFoundry lists its address as Ensemble Labs Inc, 355 Bryant Street, Suite 403, San Francisco, California 94107. · truefoundry.com, 4 Oct 2026
Company size and location: LinkedIn lists TrueFoundry as privately held, headquartered in San Francisco, with 51–200 employees and a 2021 founding year. · linkedin.com, 15 Oct 2026
Configuration extensibility: Gateway policies can be managed in the UI or declared in YAML and applied through the TrueFoundry CLI for GitOps workflows. · truefoundry.com, 15 Oct 2026
Cost controls: Usage visibility, token tracking, quotas, budgets, rate limits, caching and batching are provided to control inference spend. · truefoundry.com, 15 Oct 2026
Deployment: The gateway supports SaaS and, for Enterprise, VPC, on-premises and air-gapped deployment options. · truefoundry.com, 4 Oct 2026
Deployment options: The product is offered as SaaS and can also run in a customer VPC, on premises or in an air-gapped environment. · aws.amazon.com, 15 Oct 2026
Documentation depth: The docs include provider catalogs, authentication, self-hosted model setup, metrics APIs and a large endpoint reference covering multiple media and model operations. · truefoundry.com, 15 Oct 2026
Founded: TrueFoundry states it was founded in 2021 by Nikunj Bajaj, Abhishek Choudhary and Anuraag Gutgutia. · truefoundry.com, 4 Oct 2026
Funding: TrueFoundry announced a $19 million Series A led by Intel Capital, bringing reported total funding to $21 million. · truefoundry.com, 15 Oct 2026
Guardrails: Configurable input and output controls can filter PII, detect prompt injection, assess toxicity and apply organization-specific safety policies. · truefoundry.com, 15 Oct 2026
Headquarters: San Francisco, California, United States · truefoundry.com, 23 Sept 2026
Limit: documentation and RBAC: G2 reviewers mention documentation lag or insufficient onboarding detail, missing edge-case examples and requests for stronger RBAC or deployment approvals. · g2.com, 15 Oct 2026
Limit: outage communication: Gartner reviewers repeatedly ask TrueFoundry to communicate its own downtime more proactively. · gartner.com, 15 Oct 2026
Limit: pricing: G2 pricing analysis reports that some small businesses and startups consider the paid tiers expensive, especially for enterprise and on-premises deployments. · g2.com, 15 Oct 2026
MCP integrations: Native MCP support connects tools such as Slack, GitHub, Confluence and Datadog, with OAuth2, RBAC and metadata policies on tool calls. · truefoundry.com, 15 Oct 2026
Microsoft Marketplace availability: TrueFoundry AI Gateway is listed in Microsoft Marketplace as an Azure product for governed, observable AI-agent deployment. · marketplace.microsoft.com, 15 Oct 2026
Model coverage: TrueFoundry says the gateway connects more than 1,600 models, while its provider documentation lists integrations across more than 35 platforms and over 1,000 LLMs. · truefoundry.com, 15 Oct 2026
Model providers: TrueFoundry says the gateway integrates with 1,000+ LLMs across 35+ platforms, including OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI and Anthropic. · truefoundry.com, 4 Oct 2026
Notable news: TrueFoundry announced TrueFailover in January 2026 to reroute enterprise AI traffic automatically during model-provider outages. · truefoundry.com, 15 Oct 2026
Observability: Monitoring covers requests, tokens, cost, latency percentiles, time to first token, inter-token latency and request-level traces. · truefoundry.com, 15 Oct 2026
Praise: deployment and governance: G2 reviewers praise one-click deployment, centralized infrastructure and governance, observability, routing and reduced DevOps work. · g2.com, 15 Oct 2026