Advent Prompt Pwn vs PyRIT

Advent Prompt Pwn

6.9 #14 in AI Red Teaming Tools

About Advent Prompt Pwn

PyRIT

7.3 #11 in LLM Evaluation Tools

About PyRIT
Advent Prompt PwnPyRIT
Free planYes
Free trialNo
Paid fromFree
Platformsapi, Linux, macOS, Windowsapi, Linux, self-hosted, Web
Attack categoriesdirect prompt injection; instruction override; delimiter; encoding; role confusion; indirect document; indirect fixture; multi-turn; mutation; RAG poisoning; synthetic tool use
Target systemslanguage models; AI applications; OpenAI; Azure OpenAI; Anthropic; Gemini; OpenAI-compatible APIs; Ollama; HTTP JSON applications; Python callbacks; in-memory applications
Automation levelautomated
Custom testsYes
Deploymentself_hosted
Continuous monitoringNo
Report exportsJSON; JSONL; Markdown; HTML; JUnit; SARIF
Deployment optionsboth
Custom metricsYes
LLM-as-a-judgeYes
Safety evaluationsYes
CI/CD integrationYes

Listed together in Best AI Red Teaming Tools