evals.report
BenchmarksLabsCompareRun guidesIn the wild
Models
1 selected
Muse SparkMeta
Benchmarks
3 selected
SWE-bench VerifiedCodingDeepSWECodingSWE-bench ProCoding
BenchmarkMuse SparkMeta
SWE-bench Verified% resolved
DeepSWE% resolved
SWE-bench Pro% resolved55.00%
% resolved
% resolved
55.00%

No aggregate score is calculated. Each row uses its benchmark’s own metric. Compare rows independently.