Freedom251 › AgentBench

Instead of AgentBench

AgentBench alternatives

Apps that do what AgentBench does, from the llm evaluation tools list, the ones you can start free with first.

1. 1

   Arena (formerly Chatbot Arena)

   Free plan Open source APISelf-hostedWeb
   9.1 Free plan Visit site
2. 2

   DeepEval

   Free plan Open source APILinuxMac+3
   9.1 Free plan Visit site
3. 3

   Giskard

   Free plan Open source APILinuxSelf-hosted+1
   9.0 Free plan Visit site
4. 4

   Promptfoo

   Free plan Open source APILinuxMac+3
   8.7 Free plan Visit site
5. 5 T

   TruLens

   Free plan Open source APISelf-hosted
   8.2 Open source Visit site
6. 6

   Braintrust

   Free plan APISelf-hostedWeb
   7.5 Free plan · paid from $249/mo Visit site
7. 7

   Confident AI

   Free plan APISelf-hostedWeb
   7.4 Free plan · paid from $200/mo Visit site
8. 8 G

   garak

   Free plan LinuxMacSelf-hosted+1
   7.4 Free plan Visit site
9. 9

   Galileo

   Free plan APISelf-hostedWeb
   7.3 Free plan · paid from $100/mo (annual) Visit site
10. 10 A

    ARES

    Free plan APILinuxSelf-hosted
    7.2 Open source Visit site
11. 11

    HELM

    Free plan APISelf-hostedWeb
    7.2 Open source Visit site
12. 12 E

    EvalPlus

    Free plan APILinuxSelf-hosted
    7.1 Open source Visit site
13. 13 L

    LM Evaluation Harness

    Free plan APILinuxSelf-hosted
    7.1 Open source Visit site
14. 14

    Inspect AI

    Free plan APIExtension
    7.0 Open source Visit site
15. 15

    Maxim AI

    Free plan APISelf-hostedWeb
    7.0 Free plan · paid from $29/user/mo · 14-day trial Visit site
16. 16 O

    OpenCompass

    Free plan APILinuxSelf-hosted
    7.0 Free plan Visit site
17. 17 P

    Parea AI

    Free plan APISelf-hostedWeb
    7.0 Free plan Visit site
18. 18 P

    PyRIT

    Free plan APILinuxSelf-hosted+1
    7.0 Open source Visit site
19. 19 H

    HarmBench

    Free plan APILinuxSelf-hosted
    6.9 Free plan Visit site
20. 20 S

    SWE-bench

    Free plan APILinuxMac+3
    6.7 Free plan Visit site
21. 21

    Ragas

    Free plan APILinuxSelf-hosted
    6.6 Free plan Visit site
22. 22 R

    RAGChecker

    Free plan Self-hosted
    6.5 Open source Visit site
23. 23 O

    OpenAI Evals

    Free plan Web
    5.6 Free plan Visit site
24. 24

    DecodingTrust

    Paid APISelf-hosted
    5.4 Open source Visit site

← Back to AgentBench The whole llm evaluation tools list