Freedom251 › Inspect AI

Instead of Inspect AI

Inspect AI alternatives

Apps that do what Inspect AI does, from the llm evaluation tools list, the ones you can start free with first.

1. 1

   Giskard

   Free plan Open source APILinuxSelf-hosted+1
   9.0 Free plan Visit site
2. 2

   Promptfoo

   Free plan Open source APILinuxMac+3
   8.7 Free plan Visit site
3. 3 T

   TruLens

   Free plan Open source APISelf-hosted
   8.2 Open source Visit site
4. 4

   Braintrust

   Free plan APISelf-hostedWeb
   7.5 Free plan · paid from $249/mo Visit site
5. 5

   Confident AI

   Free plan APISelf-hostedWeb
   7.4 Free plan · paid from $200/mo Visit site
6. 6 G

   garak

   Free plan LinuxMacSelf-hosted+1
   7.4 Free plan Visit site
7. 7 A

   AgentBench

   Free plan APILinuxSelf-hosted
   7.3 Free plan Visit site
8. 8

   Galileo

   Free plan APISelf-hostedWeb
   7.3 Free plan · paid from $100/mo (annual) Visit site
9. 9 A

   ARES

   Free plan APILinuxSelf-hosted
   7.2 Open source Visit site
10. 10

    HELM

    Free plan APISelf-hostedWeb
    7.2 Open source Visit site
11. 11 E

    EvalPlus

    Free plan APILinuxSelf-hosted
    7.1 Open source Visit site
12. 12 L

    LM Evaluation Harness

    Free plan APILinuxSelf-hosted
    7.1 Open source Visit site
13. 13

    Maxim AI

    Free plan APISelf-hostedWeb
    7.0 Free plan · paid from $29/user/mo · 14-day trial Visit site
14. 14 O

    OpenCompass

    Free plan APILinuxSelf-hosted
    7.0 Free plan Visit site
15. 15 P

    Parea AI

    Free plan APISelf-hostedWeb
    7.0 Free plan Visit site
16. 16 P

    PyRIT

    Free plan APILinuxSelf-hosted+1
    7.0 Open source Visit site
17. 17 H

    HarmBench

    Free plan APILinuxSelf-hosted
    6.9 Free plan Visit site
18. 18 S

    SWE-bench

    Free plan APILinuxMac+3
    6.7 Free plan Visit site
19. 19

    Ragas

    Free plan APILinuxSelf-hosted
    6.6 Free plan Visit site
20. 20 R

    RAGChecker

    Free plan Self-hosted
    6.5 Open source Visit site
21. 21 O

    OpenAI Evals

    Free plan Web
    5.6 Free plan Visit site
22. 22

    DecodingTrust

    Paid APISelf-hosted
    5.4 Open source Visit site
23. 23 L

    LiveBench

    Paid LinuxMacSelf-hosted+2
    5.3 Open source Visit site
24. 24 W

    WebArena

    Paid Self-hosted
    4.6 Open source Visit site

← Back to Inspect AI The whole llm evaluation tools list