Galileo vs PyRIT

Galileo

7.3 #6 in AI Agent Observability Tools

About Galileo

PyRIT

5.1 #18 in LLM Evaluation Tools

About PyRIT
GalileoPyRIT
Free planYesNo
Free trialNoNo
Paid from$100/mo—
Open sourceNoNo
Platformsapi, self-hosted, WebWeb
Free planYes—
Paid from100 /mo—
Deployment optionsbothboth
Custom metricsYesYes
LLM-as-a-judgeYesYes
Safety evaluationsYesYes
Human review workflowsYes—
Prompt versioningYes—
CI/CD integrationYesYes

Both are listed in Best LLM Evaluation Tools. On Inferse, Galileo scores higher on our published basis.