DecodingTrust vs Promptfoo

DecodingTrust

4.9 #27 in LLM Evaluation Tools

About DecodingTrust

Promptfoo

7.3 #10 in AI LLM Evaluation Tools

About Promptfoo
DecodingTrustPromptfoo
Free planNoYes
Free trialNoNo
Paid from—Free
Open sourceNoNo
Platformsapi, self-hostedapi, Linux, macOS, self-hosted, Web, Windows
Deployment optionsself-hostedboth
Safety evaluationsYesYes
Free plan—Yes
Custom metrics—Yes
LLM-as-a-judge—Yes
Human review workflows—Yes
CI/CD integration—Yes

Both are listed in Best LLM Evaluation Tools. On Inferse, Promptfoo scores higher on our published basis.