FREEDOM251

Freedom251 › AI Tools

Free and open first

Best Llm Monitoring in 2026

  1. 1

    Agenta

    Free plan Open source APISelf-hostedWeb

    Agenta combines agent-building, automation, and run observability, with both cloud and self-hosted options.

    9.2 Free plan · paid from $29/mo Visit site
  2. 2

    AgentOps

    Free plan Open source APISelf-hostedWeb

    AgentOps brings tracing, replay, audit trails, and cost monitoring together for agent applications, with broad framework and provider integrations.

    9.1 Free plan · paid from $40/mo Visit site
  3. 3

    Future AGI AI Evaluation SDK

    Free plan Open source APILinuxMac+3

    Future AGI brings evaluation, tracing, and simulation together for teams building AI agents, with several deployment options.

    9.0 Free plan · paid from $0/mo Visit site
  4. 4

    Langfuse

    Free plan Open source APILinuxSelf-hosted+1

    Langfuse brings tracing, prompt workflows, and evaluation features into one AI engineering platform, with both hosted and self-hosted options.

    8.8 Free plan · paid from $29/mo Visit site
  5. 5

    LangWatch

    Free plan Open source APILinuxMac+2

    LangWatch brings agent simulation, evaluation, tracing, and deployment options together for teams working toward production.

    8.8 Free plan · paid from €29/user/mo Visit site
  6. 6

    OpenLIT

    Free plan Open source APILinuxMac+3

    Choose OpenLIT if you want LLM tracing, evaluations, prompt tools, and cost tracking, with the option to self-host under an Apache 2.0 license.

    8.7 Free plan Visit site
  7. 7

    Opik

    Free plan Open source APILinuxMac+3

    Opik brings tracing, evaluation, testing, and production monitoring into one platform, with both cloud and self-hosted options.

    8.6 Free plan · paid from $19/mo Visit site
  8. 8

    W&B Weave

    Free plan Open source APIiPhoneLinux+4

    W&B Weave brings tracing, evaluation, monitoring, and safety scoring together for production AI agents.

    8.5 Free plan · paid from $60/mo · 30-day trial Visit site
  9. 9

    Traceloop

    Free plan Open source APISelf-hostedWeb

    Traceloop brings tracing, evaluation, and release checks together, with OpenLLMetry available for exporting observability data.

    8.4 Free plan Visit site
  10. 10

    TruLens

    Free plan Open source APISelf-hosted

    TruLens offers tracing, evaluation, and version comparison for AI applications, with customizable metrics and self-hosted storage options.

    8.2 Open source Visit site
  11. 11

    Arize AX

    Free plan APISelf-hostedWeb

    Arize AX combines tracing, evaluations and experiments with tools for investigating agent failures.

    7.5 Free plan · paid from $50/mo Visit site
  12. 12

    Arize Phoenix

    Free plan APISelf-hostedWeb

    Phoenix brings tracing, evaluation, prompt inspection, and dataset experiments to AI application teams. It is free and open source, with deployment choices and usage management left to users.

    7.5 Free plan Visit site
  13. 13

    Braintrust

    Free plan APISelf-hostedWeb

    Braintrust combines production trace inspection with dataset evaluations and prompt iteration.

    7.3 Free plan · paid from $249/mo Visit site
  14. 14

    Galileo

    Free plan APISelf-hostedWeb

    Galileo combines evaluation, observability, and guardrails with several deployment options and developer interfaces. Check the trace allowance and SSO availability against your deployment needs.

    7.2 Free plan · paid from $100/mo (annual) Visit site
  15. 15

    Helicone

    Free plan APISelf-hostedWeb

    Helicone brings routing and observability tools together, with a free tier and self-hosting options. Its maintenance-mode status is worth weighing when considering it for a new deployment.

    7.2 Free plan · paid from $79/mo · 7-day trial Visit site
  16. 16

    LangSmith

    Free plan APILinuxMac+3

    LangSmith combines agent evaluation with prompt tools and observability, including cost and trajectory tracking.

    7.2 Free plan · paid from $39/user/mo Visit site
  17. 17

    HoneyHive

    Free plan APISelf-hostedWeb

    HoneyHive covers trace inspection, evaluations, live monitoring, and version experiments for AI agents. Teams should compare the free plan’s limits with their event volume and retention needs.

    7.1 Free plan Visit site
  18. 18

    Laminar

    Free plan APISelf-hostedWeb

    Choose Laminar if you need OpenTelemetry-native tracing and debugging for AI agents, with evaluations and cloud or self-hosted deployment options.

    7.1 Free plan · paid from $30/mo Visit site
  19. 19

    Portkey

    Free plan APISelf-hostedWeb

    Portkey brings model access, prompt management, and activity monitoring under one platform. Review the plan's log retention, deployment, and support terms against your team's requirements.

    6.8 Free plan · paid from $49/mo Visit site
  20. 20

    Cognifity Verdict

    Free plan LinuxMacWeb+1
    6.3 Free plan Visit site
  21. 21

    Athina

    Free plan Web
    6.0 Free plan · pricing on request Visit site
  22. 22

    Datadog LLM Observability

    Free plan Web
    6.0 Free plan · paid from $160/mo (annual) Visit site
  23. 23

    Observe

    Free trial APILinuxMac+2

    Observe combines telemetry collection, distributed tracing, integrations, and AI-assisted incident work in one platform.

    6.0 From $0.01 Visit site
  24. 24

    Bifrost AI Observability

    Free plan
    5.8 Free plan · pricing on request · 14-day trial Visit site
  25. 25

    MLflow AI Monitoring

    Free plan Web
    5.6 Free plan Visit site

#1Places #1, #2, #3, #4, #5 on this list can be bought by the makers of the software on it. See the price

More in AI Tools