Best AI Security Testing Tools in 2026
Updated
In short: AIRTA Red Team is ranked #1 of 29 as of 7 October 2026, ahead of OpenSecureAI Scanner and Project Moonshot. The best-ranked option with a free plan is OpenSecureAI Scanner. The lowest first paid tier on this page is PromptGuard at $19/mo.
AI security testing tools let you probe AI systems for weaknesses before those systems are put to work. Compare custom test cases with data leakage, jailbreak, prompt injection, and unsafe output tests to see which checks align with your concerns. Deployment mode, free plan availability, and paid-from pricing offer additional factors for weighing fit. OpenSecureAI Scanner, Project Moonshot, and Promptfoo are among the named options, alongside PromptGuard and PyRIT. Consider the risks you want to assess and whether each tool’s listed deployment and plan details suit your testing needs.
29 AI security testing tools ranked on what their makers publish — plans and prices, free tiers, platforms and the facts on their own pages.
13 of the 25 here have a free tier you can use, 0 have open-source code on record, and 0 have full bars: free, open, on most of your devices and documented.
| # | App | Signal | Free tier | Open code | Devices | From | Score |
|---|---|---|---|---|---|---|---|
| 1 | AIRTA Red TeamWeb · Windows · Mac · Linux · API | Three bars | — | 4 of 6 | Free | 6.6 | |
| 2 | OpenSecureAI ScannerWeb · Windows · Mac · Linux · API | Three bars | — | 4 of 6 | $49/mo | 6.6 | |
| 3 | Project MoonshotWeb · Windows · Mac · Linux · Self-hosted · API | Three bars | — | 4 of 6 | Free | 6.6 | |
| 4 | PromptfooWeb · Windows · Mac · Linux · Self-hosted · API | Three bars | — | 4 of 6 | Free | 6.6 | |
| 5 | PromptGuardWeb · Windows · Mac · Linux · Self-hosted · API · Extension | Three bars | — | 4 of 6 | $19/mo | 6.6 | |
| 6 | PyRITWeb · Windows · Mac · Linux · Self-hosted · API | Three bars | — | 4 of 6 | Free | 6.6 | |
| 7 | AugustusWindows · Mac · Linux · Self-hosted | Three bars | — | 3 of 6 | Free | 6.5 | |
| 8 | BasiliskWindows · Mac · Linux | Three bars | — | 3 of 6 | Free | 6.5 | |
| 9 | AgentScanWeb · API | Two bars | — | 1 of 6 | $29/mo | 6.4 | |
| 10 | CrucibleLinux · Self-hosted | Two bars | — | 1 of 6 | Free | 6.4 | |
| 11 | garakWindows · Mac · Linux · Self-hosted | Three bars | — | 3 of 6 | Free | 6.4 | |
| 12 | GiskardWeb · Linux · Self-hosted · API | Two bars | — | 2 of 6 | Free | 6.4 | |
| 13 | LLMMapLinux | Two bars | — | 1 of 6 | Free | 6.3 | |
| 14 | F5 BIG-IP APMWeb · Windows · Mac · Linux · Android · iPhone · Self-hosted · API | Two bars | — | — | 6 of 6 | — | 5.4 |
| 15 | SuperRedLinux | One bar | — | — | 1 of 6 | — | 5.4 |
| 16 | RAMPARTWindows · Mac · Linux | One bar | — | — | 3 of 6 | — | 5.3 |
| 17 | AIRTaaSWeb | No signal | — | — | 1 of 6 | — | 5.2 |
| 18 | Akto Agentic Red TeamingWeb | No signal | — | — | 1 of 6 | — | 5.2 |
| 19 | MindgardWeb | No signal | — | — | 1 of 6 | — | 5.2 |
| 20 | Prompt Security AI Red TeamingWeb | No signal | — | — | 1 of 6 | — | 5.2 |
| 21 | PromptRAIDWindows · Linux | No signal | — | — | 2 of 6 | — | 5.2 |
| 22 | SENTINEL REDWeb | No signal | — | — | 1 of 6 | — | 5.2 |
| 23 | AgentDojoNo platforms listed | No signal | — | — | 0 of 6 | — | 5.1 |
| 24 | CyberSecEvalNo platforms listed | No signal | — | — | 0 of 6 | — | 5.1 |
| 25 | DeepTeamNo platforms listed | No signal | — | — | 0 of 6 | — | 5.1 |
Compare all 25 in a table
| # | App | Score | Free plan | From | Free plan | Paid from | Prompt injection tests | Jailbreak tests |
|---|---|---|---|---|---|---|---|---|
| 1 | AIRTA Red Team | 6.6 | Free plan | Free | Yes | — | Yes | Yes |
| 2 | OpenSecureAI Scanner | 6.6 | Free plan | $49/mo | Yes | 49 /mo | Yes | Yes |
| 3 | Project Moonshot | 6.6 | Free plan | Free | Yes | — | Yes | Yes |
| 4 | Promptfoo | 6.6 | Free plan | Free | Yes | — | — | — |
| 5 | PromptGuard | 6.6 | Free plan | $19/mo | Yes | — | Yes | Yes |
| 6 | PyRIT | 6.6 | Free plan | Free | Yes | — | Yes | Yes |
| 7 | Augustus | 6.5 | Free plan | Free | — | — | Yes | Yes |
| 8 | Basilisk | 6.5 | Free plan | Free | Yes | — | Yes | Yes |
| 9 | AgentScan | 6.4 | Free plan | $29/mo | Yes | 29 /mo | Yes | Yes |
| 10 | Crucible | 6.4 | Free plan | Free | Yes | — | Yes | Yes |
| 11 | garak | 6.4 | Free plan | Free | Yes | — | — | — |
| 12 | Giskard | 6.4 | Free plan | Free | Yes | — | — | — |
| 13 | LLMMap | 6.3 | Free plan | Free | — | — | Yes | Yes |
| 14 | F5 BIG-IP APM | 5.4 | No | — | — | — | Yes | Yes |
| 15 | SuperRed | 5.4 | No | — | Yes | — | Yes | Yes |
| 16 | RAMPART | 5.3 | No | — | — | — | Yes | — |
| 17 | AIRTaaS | 5.2 | No | — | Yes | — | Yes | Yes |
| 18 | Akto Agentic Red Teaming | 5.2 | No | — | — | — | Yes | Yes |
| 19 | Mindgard | 5.2 | No | — | — | — | Yes | Yes |
| 20 | Prompt Security AI Red Teaming | 5.2 | No | — | — | — | Yes | Yes |
| 21 | PromptRAID | 5.2 | No | — | — | — | Yes | Yes |
| 22 | SENTINEL RED | 5.2 | No | — | — | — | Yes | Yes |
| 23 | AgentDojo | 5.1 | No | — | Yes | — | Yes | Yes |
| 24 | CyberSecEval | 5.1 | No | — | Yes | — | Yes | Yes |
| 25 | DeepTeam | 5.1 | No | — | — | — | Yes | Yes |
Is your app on this list?
Numbered spots on this list can be sponsored, and a sponsored row is labelled as paid.
Questions about this list
Which AI security testing tool is ranked first on Freedom251?
AIRTA Red Team is ranked #1 of 29 with a score of 6.6. OpenSecureAI Scanner is second and Project Moonshot third.
How many of these have a free plan?
13 of the 25 on this page publish a free plan on their own pricing pages.
Which is the cheapest paid option?
On this page, PromptGuard has the lowest first paid tier we found: $19/mo.
How is this list ranked?
Ranked free-and-open first: a usable free tier and open-source code, then the platforms it runs on and its documentation.