Freedom251 › LLM Evaluation Tools
Galileo

What Galileo is
Galileo is an observability, evaluation, and guardrail platform for generative AI and agentic applications. It offers ready-made evaluations for RAG, agents, safety, and security, as well as custom evaluators. Its observability tools analyze agent behavior to surface patterns and failure modes and suggest fixes. Galileo Experiments lets teams evaluate datasets and prompts systematically and compare results. Evaluation scores can inform agent actions, tool access, and escalation paths. Developers can use Python or TypeScript SDKs or the API, with documented integrations including CrewAI, Google ADK, LangChain and LangGraph, OpenAI, Microsoft Agent Framework, Strands Agents, and Vercel AI SDK. Deployment options are SaaS, Virtual Private Cloud, and on-premises. The Free plan includes 5,000 traces per month, unlimited users, and unlimited custom evaluations. Pro costs $100 a month, billed yearly, for 50,000 monthly traces; pricing scales with trace volume. SSO supports OIDC and SAML only on a customer's own Galileo cluster, not the free version or hosted app.galileo.ai service.
Who it suits
Galileo is aimed at engineers, product managers, and subject matter experts building AI applications. It suits teams that need to evaluate agent behavior, compare experiments, or apply guardrails across hosted or self-managed deployments.
What it does well
- Free plan includes 5,000 traces per month.
- Offers custom evaluations and ready-made evaluation types.
- Supports Python and TypeScript SDKs and an API.
- SaaS, VPC, and on-premises deployment options are listed.
What to know first
- Free plan is limited to 5,000 traces per month.
- SSO is unavailable on the free version and hosted app.
- Pro pricing scales with trace volume.
Limits
The Free plan includes 5,000 traces per month. Pro costs $100 a month billed yearly and includes 50,000 traces per month; pricing scales with trace volume.
Plans
| Plan | Billed and limits | Price |
|---|---|---|
| Pro | Billed yearly · 50,000 traces per month · Standard RBAC · Advanced analytics & insights · Dedicated support: Slack · Pricing scales based on number of traces | $100 a month |
| Free | 5,000 traces per month · Unlimited users · Unlimited custom evals | On request |
| Enterprise | Custom billing options · Unlimited traces · Custom rate limits · Hosted, VPC, or on-prem deployment · Enterprise-grade security RBAC and SSO · Dedicated CSM · Real-time guardrails · 24/7 Slack, email, or phone support · Low-latency dedicated inference servers · Forward deployed engineering support | On request |
As galileo.ai lists them, read 29 Sept 2026. The maker's own page has the final word.
Getting started
- Visit the Galileo website.
- Choose SaaS, VPC, or on-premises deployment.
- Use the Python or TypeScript SDK, or the API.
- Connect a documented integration such as LangChain, OpenAI, or CrewAI.
- Start with the Free plan or choose Pro at $100 a month billed yearly.
Verdict
Galileo combines evaluation, observability, and guardrails with several deployment options and developer interfaces. Check the trace allowance and SSO availability against your deployment needs.
Questions
Is there a free plan?
Yes. It includes 5,000 traces per month, unlimited users, and unlimited custom evaluations.
How much does Pro cost?
Pro costs $100 a month, billed yearly, and includes 50,000 traces per month. Pricing scales based on trace volume.
Which deployment options are available?
Galileo lists SaaS, virtual private cloud, and on-premises deployment.
Which platforms and integrations does it support?
It is available through web, API, and self-hosted deployment. Documented integrations include CrewAI, Google ADK, LangChain and LangGraph, OpenAI, Microsoft Agent Framework, Strands Agents, and Vercel AI SDK.
Does Galileo support SSO?
Yes. SSO supports OIDC and SAML providers, but only on a customer's own Galileo cluster—not the free version or hosted app.galileo.ai service.
Who makes Galileo?
Galileo says it was founded in 2021.
Facts from Galileo's own pages
- Access control
- Galileo provides role-based access controls, while groups are available to customers on paid plans. · docs.galileo.ai, 29 Sept 2026
- Audience
- Galileo says it is designed for engineers, product managers, and subject matter experts building safe and reliable AI applications. · docs.galileo.ai, 29 Sept 2026
- Company founding
- Galileo says it was founded in 2021. · galileo.ai, 29 Sept 2026
- Deployment
- The site lists SaaS, Virtual Private Cloud, and on-premises deployment options. · galileo.ai, 29 Sept 2026
- Evaluation
- The platform offers out-of-the-box evaluations for RAG, agents, safety, and security, along with custom evaluators. · galileo.ai, 29 Sept 2026
- Experiments
- Galileo Experiments support systematic evaluation using datasets, prompts, and experiment comparisons. · docs.galileo.ai, 29 Sept 2026
- Founded
- 2021 · galileo.ai, 28 Sept 2026
- Free plan limit
- The Free plan includes 5,000 traces per month, unlimited users, and unlimited custom evaluations. · galileo.ai, 29 Sept 2026
- Guardrails
- Galileo describes a workflow in which evaluation scores can control agent actions, tool access, and escalation paths. · galileo.ai, 29 Sept 2026
- Integrations
- Documented integrations include CrewAI, Google ADK, LangChain and LangGraph, OpenAI, Microsoft Agent Framework, Strands Agents, and Vercel AI SDK. · docs.galileo.ai, 29 Sept 2026
- Observability
- Galileo analyzes agent behavior to identify failure modes, surface patterns, and suggest fixes. · galileo.ai, 29 Sept 2026
- Purpose
- Galileo is an observability, evaluation, and guardrail platform for GenAI and agentic applications. · docs.galileo.ai, 29 Sept 2026
- SDKs and API
- The platform can be used through Python and TypeScript SDKs or its API. · docs.galileo.ai, 29 Sept 2026
- Single sign-on
- SSO supports OIDC and SAML providers, but is available only on a customer's own Galileo cluster and not on the free version or hosted app.galileo.ai service. · docs.galileo.ai, 29 Sept 2026
- Support
- The Pro plan includes dedicated Slack support, and Enterprise includes 24/7 support via Slack, email, or phone. · galileo.ai, 29 Sept 2026
Where Galileo stands on Freedom251
- LLM Evaluation Tools#10 of 29
- AI Agent Evaluation Tools#12 of 28
- AI LLM Evaluation Tools#13 of 30
- Machine Learning Model Monitoring Software#9 of 20
- Prompt Engineering Tools#12 of 25
- AI Agent Observability Tools#15 of 31
- Llm Monitoring#14 of 26
- Model Monitoring Software#15 of 24
- AI LLM Observability Tools#15 of 23
- LLM Observability Tools#17 of 26
