EvalPlus vs Galileo

EvalPlus

4.8 #28 in LLM Evaluation Tools

About EvalPlus

Galileo

7.3 #9 in AI Agent Observability Tools

About Galileo
EvalPlusGalileo
Free planNoNo
Free trialNoNo
Paid from—$100/mo
Open sourceNoNo
Platforms—api, self-hosted, Web
Deployment optionsself-hostedboth
Free plan—Yes
Paid from—100 /mo
Custom metrics—Yes
LLM-as-a-judge—Yes
Safety evaluations—Yes
Human review workflows—Yes
Prompt versioning—Yes
CI/CD integration—Yes

Both are listed in Best LLM Evaluation Tools. On Inferse, Galileo scores higher on our published basis.