Side by side
RAMPART vs SuperRed
Both stand on ai security testing tools. Which one you can start free with, which one lets you read the code, and what each costs once you pay.
Choose RAMPART if you want a pytest-native way to test agent safety, including cross-prompt injection and expected behavior. It is a fit for teams comfortable supplying an agent adapter and managing a Python installation; account for its documented xdist restrictions when planning parallel reporting.
Visit RAMPARTSuperRed provides modular, self-hosted testing for chatbot and agent security. Its configurable scopes, parallel runs and detailed reports support structured evaluations, but users must manage sensitive persisted trajectories and compatible Python versions.
Visit SuperRedThe facts
| RAMPART | SuperRed | |
|---|---|---|
| Free plan | Yes | Yes |
| Open source | Not published | Not published |
| Runs on | API, Linux, Mac, Windows | Linux |
| Lowest paid plan | Not published | Not published |
| Plans published | None | None |
| Maker | Not published | Not published |
| Website | microsoft.github.io | rdi.berkeley.edu |
| On ai security testing tools | #20 of 29 | #24 of 29 |
RAMPART: what it does well
- Free and MIT-licensed.
- Runs within pytest and registers automatically as a plugin.
- Includes a cross-prompt injection attack test and behavior probe.
- Reports safety status, traces, and evaluation details.
- Supports parallel pytest-xdist runs with a unified report.
What to know first
- Requires Python 3.11 or later.
- Users must provide an adapter connecting their agent.
- Teardown-only results are excluded from xdist report streaming.
- Mixed RAMPART versions across xdist controller and workers are unsupported.
SuperRed: what it does well
- 35 attacker, target and benchmark modules
- Parallel threat-model execution
- Live dashboard and web reports
- Configurable security scopes and budgets
- Supports prompt injection and jailbreak tests
What to know first
- Python 3.14 is unsupported
- Guide assumes Python and asyncio knowledge
- Persisted trajectories are not scrubbed
- Alpha development status
Alternatives to RAMPART Alternatives to SuperRed The whole list