evals.report
BenchmarksLabsCompareRun guides
Models
1 selected
Llama 3.1 405BMeta
Benchmarks
2 selected
SWE-bench VerifiedCodingGPQA DiamondReasoning
BenchmarkLlama 3.1 405BMeta
SWE-bench Verified% resolved
GPQA Diamondaccuracy50.9%
SWE-bench Verified
% resolved
Llama 3.1 405B · Meta
GPQA Diamond
accuracy
Llama 3.1 405B · Meta
50.9%

No aggregate score is calculated. Each row uses its benchmark’s own metric. Compare rows independently.