Freedom251 › Arena (formerly Chatbot Arena)

Instead of Arena (formerly Chatbot Arena)

Arena (formerly Chatbot Arena) alternatives

Apps that do what Arena (formerly Chatbot Arena) does, from the llm evaluation tools list, the ones you can start free with first.

1. 1

   DeepEval

   Free plan Open source APILinuxMac+3
   9.1 Free plan Visit site
2. 2

   Giskard

   Free plan Open source APILinuxSelf-hosted+1
   9.0 Free plan Visit site
3. 3

   Promptfoo

   Free plan Open source APILinuxMac+3
   8.7 Free plan Visit site
4. 4 T

   TruLens

   Free plan Open source APISelf-hosted
   8.2 Open source Visit site
5. 5

   Braintrust

   Free plan APISelf-hostedWeb
   7.5 Free plan · paid from $249/mo Visit site
6. 6

   Confident AI

   Free plan APISelf-hostedWeb
   7.4 Free plan · paid from $200/mo Visit site
7. 7 G

   garak

   Free plan LinuxMacSelf-hosted+1
   7.4 Free plan Visit site
8. 8 A

   AgentBench

   Free plan APILinuxSelf-hosted
   7.3 Free plan Visit site
9. 9

   Galileo

   Free plan APISelf-hostedWeb
   7.3 Free plan · paid from $100/mo (annual) Visit site
10. 10 A

    ARES

    Free plan APILinuxSelf-hosted
    7.2 Open source Visit site
11. 11

    HELM

    Free plan APISelf-hostedWeb
    7.2 Open source Visit site
12. 12 E

    EvalPlus

    Free plan APILinuxSelf-hosted
    7.1 Open source Visit site
13. 13 L

    LM Evaluation Harness

    Free plan APILinuxSelf-hosted
    7.1 Open source Visit site
14. 14

    Inspect AI

    Free plan APIExtension
    7.0 Open source Visit site
15. 15

    Maxim AI

    Free plan APISelf-hostedWeb
    7.0 Free plan · paid from $29/user/mo · 14-day trial Visit site
16. 16 O

    OpenCompass

    Free plan APILinuxSelf-hosted
    7.0 Free plan Visit site
17. 17 P

    Parea AI

    Free plan APISelf-hostedWeb
    7.0 Free plan Visit site
18. 18 P

    PyRIT

    Free plan APILinuxSelf-hosted+1
    7.0 Open source Visit site
19. 19 H

    HarmBench

    Free plan APILinuxSelf-hosted
    6.9 Free plan Visit site
20. 20 S

    SWE-bench

    Free plan APILinuxMac+3
    6.7 Free plan Visit site
21. 21

    Ragas

    Free plan APILinuxSelf-hosted
    6.6 Free plan Visit site
22. 22 R

    RAGChecker

    Free plan Self-hosted
    6.5 Open source Visit site
23. 23 O

    OpenAI Evals

    Free plan Web
    5.6 Free plan Visit site
24. 24

    DecodingTrust

    Paid APISelf-hosted
    5.4 Open source Visit site

← Back to Arena (formerly Chatbot Arena) The whole llm evaluation tools list