Freedom251 › OpenCompass

Instead of OpenCompass

OpenCompass alternatives

Apps that do what OpenCompass does, from the llm evaluation tools list, the ones you can start free with first.

1. 1 T

   TruLens

   Free plan Open source APISelf-hosted
   8.2 Open source Visit site
2. 2

   Braintrust

   Free plan APISelf-hostedWeb
   7.5 Free plan · paid from $249/mo Visit site
3. 3

   Confident AI

   Free plan APISelf-hostedWeb
   7.4 Free plan · paid from $200/mo Visit site
4. 4 G

   garak

   Free plan LinuxMacSelf-hosted+1
   7.4 Free plan Visit site
5. 5 A

   AgentBench

   Free plan APILinuxSelf-hosted
   7.3 Free plan Visit site
6. 6

   Galileo

   Free plan APISelf-hostedWeb
   7.3 Free plan · paid from $100/mo (annual) Visit site
7. 7 A

   ARES

   Free plan APILinuxSelf-hosted
   7.2 Open source Visit site
8. 8

   HELM

   Free plan APISelf-hostedWeb
   7.2 Open source Visit site
9. 9 E

   EvalPlus

   Free plan APILinuxSelf-hosted
   7.1 Open source Visit site
10. 10 L

    LM Evaluation Harness

    Free plan APILinuxSelf-hosted
    7.1 Open source Visit site
11. 11

    Inspect AI

    Free plan APIExtension
    7.0 Open source Visit site
12. 12

    Maxim AI

    Free plan APISelf-hostedWeb
    7.0 Free plan · paid from $29/user/mo · 14-day trial Visit site
13. 13 P

    Parea AI

    Free plan APISelf-hostedWeb
    7.0 Free plan Visit site
14. 14 P

    PyRIT

    Free plan APILinuxSelf-hosted+1
    7.0 Open source Visit site
15. 15 H

    HarmBench

    Free plan APILinuxSelf-hosted
    6.9 Free plan Visit site
16. 16 S

    SWE-bench

    Free plan APILinuxMac+3
    6.7 Free plan Visit site
17. 17

    Ragas

    Free plan APILinuxSelf-hosted
    6.6 Free plan Visit site
18. 18 R

    RAGChecker

    Free plan Self-hosted
    6.5 Open source Visit site
19. 19 O

    OpenAI Evals

    Free plan Web
    5.6 Free plan Visit site
20. 20

    DecodingTrust

    Paid APISelf-hosted
    5.4 Open source Visit site
21. 21 L

    LiveBench

    Paid LinuxMacSelf-hosted+2
    5.3 Open source Visit site
22. 22 W

    WebArena

    Paid Self-hosted
    4.6 Open source Visit site
23. 23 K

    kube-bench

    Paid Linux
    4.2 Open source Visit site
24. 24 L

    Lighteval

    Paid
    4.0 Open source Visit site

← Back to OpenCompass The whole llm evaluation tools list