Freedom251 › AI Agent Evaluation Tools
W&B Weave

What W&B Weave is
W&B Weave provides observability and improvement tools for production AI agents. It organizes traces into sessions and turns, making steps, tools, and sub-agents distinct parts of an interaction. Built-in and custom signals can capture and classify activity, with alerts sent through Slack notifications or webhook automations. Its evaluation framework offers comparisons and visualizations to help spot regressions before deployment, and the Playground lets users compare models and prompting techniques against production traces. Safety scorers cover toxicity, bias, personal information detection, and hallucinations; quality scores include coherence, fluency, and context relevance. Weave works with frameworks such as LangChain and LlamaIndex and models from OpenAI, Meta, Amazon Bedrock, and Anthropic. Python and TypeScript libraries are available, as is OpenTelemetry trace submission through its OTLP endpoint. The free plan includes 1 GB of monthly data ingestion and 5 GB of storage. Pro costs $60 a month, with additional ingestion at $0.10 per MB. A 30-day trial is listed.
Who it suits
Weave suits teams building or operating production AI agents that need to inspect traces, evaluate changes, and monitor interactions. Its free plan offers a way to start, while enterprise controls are available for organizations that need them.
What it does well
- Traces organize agent sessions, turns, tools, and sub-agents.
- Evaluation comparisons help identify regressions before deployment.
- Safety and quality scorers cover several evaluation dimensions.
- Works with Python, TypeScript, and OpenTelemetry traces.
- Free plan includes 1 GB monthly ingestion and 5 GB storage.
What to know first
- Free ingestion is limited to 1 GB per month.
- Pro starts at $60 a month.
- Additional Pro ingestion costs $0.10 per MB.
Limits
The Free plan includes 1 GB per month of Weave data ingestion and 5 GB per month of storage. Pro starts at $60 a month with 1.5 GB per month of ingestion; additional ingestion costs $0.10 per MB.
Plans
| Plan | Billed and limits | Price |
|---|---|---|
| Free | AI application evaluations · AI application tracing · AI application scorers · model experiment tracking · asset registry and lineage · community support · 5 GB/mo storage · 1 GB/mo Weave ingestion | Free |
| Pro | billed monthly · Unlimited teams · team access controls · service accounts · priority email and chat support · CI/CD automations · Slack and email alerts · 100 GB/mo storage · 1.5 GB/mo Weave ingestion | $60 a month |
| Enterprise | HIPAA-compliant option · private connectivity · customer-managed encryption keys · SSO · automated provisioning · custom roles · audit logs · enterprise support | On request |
As site.wandb.ai lists them, read 20 Oct 2026. The maker's own page has the final word.
Getting started
- Visit the W&B Weave website
- Choose the Free plan or review Pro and Enterprise options
- Use the 30-day trial if evaluating a paid plan
- Connect using the Python or TypeScript library, or send OpenTelemetry traces to the OTLP endpoint
- Set up traces, evaluations, signals, and alerts
Overview
W&B Weave is an observability and improvement platform for production AI agents, suited to teams that need to trace behavior, evaluate changes and monitor deployed applications. Its breadth is a strong fit for agent workflows; the defined ingestion allowances make volume an important part of the buying decision.
Founded in 2017 in San Francisco, Weights & Biases was acquired by CoreWeave in May 2025. Weave spans agent and LLM tracing, evaluations, prompt management, cost tracking and retrieval tracing, placing it across AI Agent Observability Tools, AI LLM Observability Tools, LLM Observability Tools, Model Monitoring Software and AI Agent Evaluation Tools.
Key features
Tracing and monitoring
Weave groups traces into sessions and turns, with steps, tools and sub-agents treated as distinct parts of an interaction. That structure gives teams a way to inspect multi-stage agent behavior rather than only isolated model calls. Built-in and custom signals capture and classify interactions, and alerts can be routed through Slack notifications or webhook automations.
Cost tracking and token cost tracking help teams account for model usage alongside LLM, agent and retrieval traces. Python and TypeScript libraries support instrumentation, and Weave also accepts OpenTelemetry traces through an OTLP endpoint. Compatibility with LangChain, LlamaIndex, and models from OpenAI, Meta, Amazon Bedrock and Anthropic makes it relevant to teams working across those ecosystems.
Evaluation, experimentation and safety
The evaluation framework compares results and visualizes them to help spot regressions before deployment. Playground lets teams compare models and prompting techniques against production traces, connecting experiments to real application activity. Pre-built safety scorers cover toxicity, bias, personally identifiable information and hallucinations; quality scorers cover coherence, fluency and context relevance. These are useful evaluation dimensions, though the stated capabilities do not establish that scores replace a team's own review criteria.
Security and enterprise controls
W&B states that its platform is certified to ISO/IEC 27001:2022, ISO/IEC 27017:2015 and ISO/IEC 27018:2019, and compliant with SOC 2 Type 2 and HIPAA standards. It says data is encrypted in transit with TLS 1.2+ and at rest with AES 256. Enterprise options include single sign-on, audit logs, secure private connectivity and customer-managed encryption keys, which matter for organizations with stricter access and data-control requirements.
Pricing
Weave is freemium, with a free plan, a 30-day trial and paid plans starting at $60/mo. The free tier costs nothing and includes 1 GB/mo of Weave data ingestion, 5 GB/mo of storage, and AI application evaluations, tracing and scorers. It is a credible starting point for small workloads, but the ingestion allowance constrains sustained high-volume use.
Pro is $60 a month, billed monthly; annual billing is also available. It starts at $60/month, includes 1.5 GB/mo of ingestion, and charges $0.10/MB for additional ingestion. The plan is for organizations with fewer than 50 employees and includes priority email and chat support. Its larger allowance and support are meaningful upgrades, but the extra-ingestion charge makes traffic forecasting important.
Enterprise has custom pricing, with customizable usage, enterprise support and security and compliance features; custom plans are invoiced annually upfront. It is the better fit when enterprise controls or support are requirements, but buyers should account for the annual upfront billing term. No seat allowance is stated for these plans.
Platforms
Weave supports API, Linux, macOS, self-hosted, web and Windows deployments. The combination of hosted and self-hosted options suits teams with different deployment needs, while SDKs and the OTLP endpoint provide instrumentation paths for Python, TypeScript and OpenTelemetry workflows.
Who it's for
Weave is best for teams building production AI agents that want tracing, evaluation, monitoring and safety scoring in one workflow. It is particularly compelling when agent steps, tool use and sub-agents need to be inspected together, or when teams want to compare prompts and models against production traces. Small teams can begin on Free; organizations with heavier ingestion or enterprise security requirements should weigh Pro's overage rate or Enterprise's custom terms.
It is less suitable for buyers who need predictable high-volume ingestion at a low fixed price, or who do not need the combined evaluation and observability scope. Pro's 1.5 GB monthly allowance is modest for sustained traffic, and overages are charged by the megabyte.
Pros and cons
- Pros: Session-and-turn tracing distinguishes steps, tools and sub-agents, useful for investigating complex agent runs.
- Pros: Evaluations, production-trace playground comparisons and safety scorers bring pre-deployment checks into the same product.
- Pros: Python and TypeScript SDKs, OTLP support, and integrations across named frameworks and model providers offer multiple instrumentation routes.
- Cons: Free ingestion is capped at 1 GB/mo, and Pro's 1.5 GB/mo allowance can incur $0.10/MB overages.
- Cons: Enterprise is custom-priced and invoiced annually upfront, making it a less straightforward option for teams that need a simple monthly commitment.
Alternatives
OpenLIT is worth considering for teams prioritizing unlimited self-hosted usage, users and projects on its free OSS plan, with community support through GitHub.
Opik is an alternative for teams that want an open-source core observability and evaluation feature set they can download and run locally.
Agenta may suit a small team looking for a free Hobby plan with two team members, 5,000 agent runs per month, 20 evaluations per month and one-week trace retention.
Arize AX is a fit for teams whose free-tier limits of 25,000 trace spans, 1 GB ingestion per month and 15-day retention align with their needs, alongside unlimited users and evaluations.
Braintrust offers a free Starter plan with 1 GB processed data, 10,000 scores, 14-day retention, and unlimited users, projects and datasets.
Confident AI is an option for a very small evaluation workload: its free plan has two seats, one project, five test runs per week and 1 GB-month of trace spans.
Galileo may fit teams considering a $100 a month Pro plan, billed yearly, with 50,000 traces per month, standard RBAC, advanced analytics and dedicated Slack support.
Helicone is another freemium option for teams that value an open-source product and community contributions.
Verdict
Choose W&B Weave if your team needs to follow production agent activity from traces through evaluations and safety scoring, and wants to compare changes against real traces. Its main advantage is the connected workflow; its main drawback is that ingestion allowances are limited and paid overages can add up. For high-volume workloads or a need for fixed, predictable costs, compare alternatives before committing.
Verdict
W&B Weave brings tracing, evaluation, monitoring, and safety scoring together for production AI agents. The free plan has a defined ingestion allowance, while higher-volume use can add ingestion charges or require another plan.
Questions
Is W&B Weave free?
Yes. The Free plan includes AI application evaluations, tracing, and scorers, plus 1 GB per month of ingestion and 5 GB per month of storage.
How much does Pro cost?
Pro starts at $60 a month. It includes 1.5 GB per month of ingestion, and additional ingestion is $0.10 per MB.
Is there a free trial?
Yes. A 30-day trial is listed.
Which frameworks and models does Weave support?
It works with frameworks including LangChain and LlamaIndex, and supports models from OpenAI, Meta, Amazon Bedrock, and Anthropic.
What languages and trace formats can I use?
Weave provides Python and TypeScript libraries and supports sending OpenTelemetry traces to its OTLP endpoint.
What security standards does W&B state it meets?
W&B states that its platform has ISO/IEC 27001:2022, ISO/IEC 27017:2015, and ISO/IEC 27018:2019 certifications, and complies with SOC 2 Type 2 and HIPAA standards.
Facts from W&B Weave's own pages
- Acquisition news
- CoreWeave announced on 4 March 2025 that it would acquire Weights & Biases and completed the acquisition on 5 May 2025. · investors.coreweave.com, 20 Oct 2026
- Agent-native tracing
- Traces are organized around sessions, turns, steps, tools and sub-agents as first-class objects. · site.wandb.ai, 20 Oct 2026
- Apple app requirements
- The W&B iPhone app requires iOS 18 or later, and its Mac version requires macOS 15 or later on Apple silicon. · apps.apple.com, 20 Oct 2026
- Behavior monitoring
- Built-in and custom signals classify agent interactions, while Slack notifications and webhooks route detected issues. · site.wandb.ai, 20 Oct 2026
- Company
- Weights & Biases says it was founded in 2017 by Lukas Biewald, Chris Van Pelt, and Shawn Lewis and was acquired by CoreWeave in May 2025. · site.wandb.ai, 30 Sept 2026
- Company facts
- LinkedIn lists Weights & Biases as privately held, founded in 2017, headquartered in San Francisco and employing 201–500 people. · linkedin.com, 20 Oct 2026
- Deployment options
- The deployment guide describes multi-tenant SaaS and single-tenant AWS Dedicated Cloud deployments for Weave. · site.wandb.ai, 20 Oct 2026
- Documentation depth
- The support center lists a dedicated Weave section with 16 articles and eight tags. · docs.wandb.ai, 20 Oct 2026
- Encryption
- W&B states that data is encrypted in transit using TLS 1.2+ and at rest using AES 256. · site.wandb.ai, 30 Sept 2026
- Enterprise controls
- Enterprise pricing lists options including single sign-on, audit logs, secure private connectivity, and customer-managed encryption keys. · site.wandb.ai, 30 Sept 2026
- Evaluations
- An imperative evaluation API compares application or model changes with visualizations intended to expose regressions. · site.wandb.ai, 20 Oct 2026
- Founded
- 2017 · site.wandb.ai, 28 Sept 2026
- Guardrails
- Prebuilt safety scorers cover toxicity, bias, PII and hallucinations, while quality scorers cover coherence, fluency and context relevance. · site.wandb.ai, 20 Oct 2026
- Headquarters
- San Francisco, California, United States · site.wandb.ai, 28 Sept 2026
- Integrations
- The deployment guide lists integrations for OpenAI, Anthropic, Cohere, Mistral, LangChain, LlamaIndex, DSPy, Google Gemini, Amazon Bedrock, Together and Groq. · site.wandb.ai, 20 Oct 2026
- Leaderboards
- Evaluation results can be aggregated into leaderboards and shared across an organization. · site.wandb.ai, 20 Oct 2026
- Legal name and ownership
- Crunchbase identifies the legal entity as Weights & Biases, Inc., founded by Chris Van Pelt, Lukas Biewald and Shawn Lewis, and records seven funding rounds and acquisition by CoreWeave. · crunchbase.com, 20 Oct 2026
- Licence
- The public Weave repository is released under the Apache-2.0 license. · github.com, 20 Oct 2026
- Limit: Apple app access
- An App Store reviewer complained that meaningful functionality is gated behind a paid multi-tenant account. · apps.apple.com, 20 Oct 2026
- Limit: G2 complexity and cost
- G2 reviewers repeatedly mention an overwhelming interface, documentation or guidance gaps, sluggish charts on large projects and rapidly rising storage or per-user costs. · g2.com, 20 Oct 2026
- Limit: independent review pricing
- Aicoolies says ingestion is usage-based and can make total cost difficult to estimate before a representative trial. · aicoolies.com, 20 Oct 2026
- Limit: TrustRadius
- TrustRadius reviewers report dashboard lag with many metrics and say custom-chart support and documentation are not straightforward. · trustradius.com, 20 Oct 2026
- MCP extensibility
- W&B skills and an MCP server let coding agents such as Claude Code read production data, run evaluations and iterate automatically. · site.wandb.ai, 20 Oct 2026
- Monitoring
- Built-in and custom signals capture and classify agent interactions, and alerts can be routed through Slack notifications and webhook automations. · site.wandb.ai, 30 Sept 2026
Where W&B Weave stands on Freedom251
- AI Agent Evaluation Tools#7 of 28
- Prompt Engineering Tools#7 of 25
- AI Agent Observability Tools#9 of 31
- Llm Monitoring#8 of 26
- AI LLM Observability Tools#8 of 23
- Model Monitoring Software#9 of 24
- LLM Observability Tools#10 of 26
