evals.report
BenchmarksLabsCompareRun guides
Models
1 selected
DeepSeek V4 FlashDeepSeek
Benchmarks
3 selected
SWE-bench VerifiedCodingDeepSWECodingSWE-bench ProCoding
BenchmarkDeepSeek V4 FlashDeepSeek
SWE-bench Verified% resolved79.0%
DeepSWE% resolved
SWE-bench Pro% resolved52.6%

No aggregate score is calculated. Each row uses its benchmark’s own metric. Compare rows independently.