Freedom251 › OpenAI Evals

Instead of OpenAI Evals

OpenAI Evals alternatives

Apps that do what OpenAI Evals does, from the llm evaluation tools list, the ones you can start free with first.

1. 1

   HELM

   Free plan APISelf-hostedWeb
   7.2 Open source Visit site
2. 2 E

   EvalPlus

   Free plan APILinuxSelf-hosted
   7.1 Open source Visit site
3. 3 L

   LM Evaluation Harness

   Free plan APILinuxSelf-hosted
   7.1 Open source Visit site
4. 4

   Inspect AI

   Free plan APIExtension
   7.0 Open source Visit site
5. 5

   Maxim AI

   Free plan APISelf-hostedWeb
   7.0 Free plan · paid from $29/user/mo · 14-day trial Visit site
6. 6 O

   OpenCompass

   Free plan APILinuxSelf-hosted
   7.0 Free plan Visit site
7. 7 P

   Parea AI

   Free plan APISelf-hostedWeb
   7.0 Free plan Visit site
8. 8 P

   PyRIT

   Free plan APILinuxSelf-hosted+1
   7.0 Open source Visit site
9. 9 H

   HarmBench

   Free plan APILinuxSelf-hosted
   6.9 Free plan Visit site
10. 10 S

    SWE-bench

    Free plan APILinuxMac+3
    6.7 Free plan Visit site
11. 11

    Ragas

    Free plan APILinuxSelf-hosted
    6.6 Free plan Visit site
12. 12 R

    RAGChecker

    Free plan Self-hosted
    6.5 Open source Visit site
13. 13

    DecodingTrust

    Paid APISelf-hosted
    5.4 Open source Visit site
14. 14 L

    LiveBench

    Paid LinuxMacSelf-hosted+2
    5.3 Open source Visit site
15. 15 W

    WebArena

    Paid Self-hosted
    4.6 Open source Visit site
16. 16 K

    kube-bench

    Paid Linux
    4.2 Open source Visit site
17. 17 L

    Lighteval

    Paid
    4.0 Open source Visit site

← Back to OpenAI Evals The whole llm evaluation tools list