Developer Tools·Standings
AI Security Testing Tools
AI security testing tools help teams check AI applications for issues such as prompt injection, jailbreaks, data leakage and unsafe output. This board covers 29 tools and shows the test areas, deployment modes and starting prices listed for each one.
Use the signal score out of 10 as a quick comparison. The board also marks whether a tool has a public API, open-source code or a free tier. Twenty-four tools have a free plan; one has a free trial.
- 29 platforms
- 2 with a public API on this page
- 24 with a free tier
- Checked 23 Sept 2026
- 1 P
Promptfoopromptfoo.devTool for comparing prompts across 60+ model providers and simulating AI risks.
- 2 AR
AIRTA Red Teamairtasystems.comFree tool that runs authorized attacks against LLMs and applications through API or browser.
- 3 OSOpenSecureAI Scanneropensecureai.com
Open-source scanner that detects prompt injection, jailbreaks, leaks, and exfiltration.
- 4 CCyberSecEvalmeta-llama.github.io
Free benchmark suite covering cyber risks, secure code, refusal rates, and prompt injection.
- 5 G
Giskardgiskard.aiPlatform that finds agent issues such as prompt injection, leaks, hallucinations, and omissions.
- 6 P
PromptGuardpromptguard.coSecurity layer before an LLM that flags threats and masks 43 types of personal data.
- 7 PMProject Moonshotaiverifyfoundation.sg
Open-source toolkit using benchmarks and adversarial prompts to assess LLM safety.
- 8 RRAMPARTmicrosoft.github.io
Open-source pytest framework that runs agent attacks or probes and reports outcomes.
- 9 AAugustusgithub.com
Go-based scanner with 210+ probes, 47 attack categories, and 28 provider types.
- 10 B
Basiliskbasilisk.rothackers.comOpen-source red-team framework with 32 modules, prompt evolution, and many provider connections.
- 11 PPyRITazure.github.io
Open-source framework for automated or human-led red teaming of generative AI systems.
- 12 RRedForgegithub.com
Open-source LLM security platform with 49+ probes and OWASP LLM Top 10 coverage.
- 13 PPromptRAIDgithub.com
Open-source framework generating prompt-injection variants and scoring agent responses.
- 14 Ggarakgarak.ai
LLM scanner probing hallucinations, leaks, injection, toxicity, misinformation, and jailbreaks.
- 15 SSuperRedrdi.berkeley.edu
Open-source framework coordinating attackers, targets, and benchmarks for chatbot red teaming.
- 16 AAgentDojoagentdojo.spylab.ai
Open-source environment for evaluating prompt-injection attacks and defenses in agents.
- 17 RTRed Team LLM Labgithub.com
Open-source framework for injection, jailbreak, backdoor, RAG poisoning, and defense checks.
- 18 A
AgentScanagentscan.shAPI that scans LLMs, RAG pipelines, and agents across 412 attack vectors.
- 19 LLLMMapgithub.com
Linux tool that finds HTTP prompt-injection points and checks 227 techniques with LLM judges.
- 20 IInjectLabgithub.com
Open-source YAML test suite covering LLM ATT&CK tactics with scoring and mitigation guidance.
- 21 HHarmBenchgithub.com
Open-source tool for comparing automated attack methods and model defenses.
- 22 A
AIRTaaSairtaas.aiWeb platform for continuous security checks and policy validation of agentic applications.
- 23 CCruciblecrucible-security.github.io
Agent security tool with 153 attack vectors and reports on tool calls and side effects.
- 24 D
DeepTeamtrydeepteam.comOpen-source framework with 50+ vulnerabilities and simulated attacks for LLM systems.
- 25 SRSENTINEL REDsentinelred.dev
Open-source suite covering injection, hallucinations, leaks, poisoning, and compliance.
Places #1, #2, #3, #4, #5 on this board are open to sponsors. Take #1 · Other ways to advertise
How to choose
Match the checks to your needs
The board compares prompt injection, jailbreak, data leakage and unsafe output tests, along with custom test cases. Check which of these areas matter for your application before comparing prices.
Custom test cases can help when your risks do not fit the standard checks shown on the board.
Start with the available plan
Twenty-four of the 29 tools have a free plan. One tool lists a free trial, so check the plan details before committing.
Published paid starting points vary. PromptGuard lists paid plans from $19 per user each month, AgentScan from $29 per month and OpenSecureAI Scanner from $49 per month.
Check where it runs
The listed platforms include Linux, self-hosted, API, web, Windows and macOS. Counts are 21 for Linux, 19 self-hosted, 18 API, 14 web, 13 Windows and 11 macOS.
Choose a deployment mode that fits your existing setup. An API option means the software can be connected through a public programming interface; self-hosted means you run it yourself.
Review the code and access model
The board marks open-source projects separately from free plans and free trials. Project Moonshot, CyberSecEval, PyRIT and AgentDojo list a free plan, while RedForge and DeepTeam list open-source pricing notes.
A free plan does not necessarily mean the project is open source, so compare both marks when control over the code matters.
Questions
How many tools are on this board?
The list contains 29 AI security testing tools.
How many offer a free plan?
Twenty-four of the 29 tools have a free plan.
Which checks are compared?
The board compares prompt injection, jailbreak, data leakage and unsafe output tests, plus custom test cases and deployment mode.
Which platforms are listed most often?
Linux appears on 21 items, self-hosted on 19, API on 18, web on 14, Windows on 13 and macOS on 11.
Are open-source tools identified?
Yes. Open-source status is marked separately from free plans and free trials.
Some top positions on this board can be paid placements, standing where they were sold. The facts on each platform are not for sale. How we rank · Disclosure