HELM vs SWE-bench

HELM

4.9 #28 in AI LLM Evaluation Tools

About HELM

SWE-bench

5.0 #28 in LLM Evaluation Tools

About SWE-bench
HELMSWE-bench
Free planNoNo
Free trialNoNo
Paid from——
Open sourceNoNo
PlatformsWebWeb, macOS, Linux
Deployment optionsself-hostedboth
Custom metricsYes—
LLM-as-a-judgeYes—
Safety evaluationsYes—
Human review workflowsYes—
Free plan—Yes

Both are listed in Best LLM Evaluation Tools. On Inferse, SWE-bench scores higher on our published basis.