evals.report
BenchmarksLabsCompareRun guidesIn the wild

GPT-5.1

OpenAI · GPT. Released Nov 12, 2025.

GPT-5.1 is a model from OpenAI in the GPT family, released Nov 12, 2025. evals.report tracks 37 reported GPT-5.1 benchmark scores across FrontierMath, ARC-AGI-1, LiveCodeBench Pro, GPQA Diamond, SWE-bench Verified, Humanity's Last Exam, MMMU-Pro, AIME (OTIS Mock), and 29 more — each shown with its benchmark, metric, source status, and date, and never combined into a single ranking.

37 results

Benchmark results 37

Compare this model
BenchmarkCategoryScoreMetricStatusDate
FrontierMathReasoning31.03%accuracyOfficialNov 12, 2025Details
ARC-AGI-1Reasoning72.83%accuracyOfficialNov 12, 2025Details
LiveCodeBench ProCoding2269Codeforces EloOfficialNov 12, 2025Details
GPQA DiamondReasoning87.6%accuracyOfficialNov 12, 2025Details
SWE-bench VerifiedCoding68.0%% resolvedOfficialNov 12, 2025Details
Humanity's Last ExamReasoning27.2%accuracyOfficialNov 12, 2025Details
MMMU-ProMultimodal79.0%accuracyOfficialNov 12, 2025Details
AIME (OTIS Mock)Reasoning88.6%accuracyOfficialNov 12, 2025Details
SimpleQA VerifiedOther48.9%accuracyOfficialNov 12, 2025Details
ARC-AGI-2Reasoning17.64%accuracyOfficialNov 12, 2025Details
LMArenaChat preference1422source-defined ratingOfficialNov 12, 2025Details
WeirdMLCoding60.8%average accuracyOfficialNov 12, 2025Details
Artificial Analysis Intelligence IndexReasoning47.7IndexUnverifiedNov 12, 2025Details
Epoch Capabilities IndexReasoning149.7IndexOfficialNov 12, 2025Details
MMLU-ProReasoning87.0%accuracyVerifiedNov 12, 2025Details
τ²-bench (Telecom)Tool use95.6%pass^1UnverifiedNov 12, 2025Details
GDPvalAgents1227EloOfficialNov 12, 2025Details
LiveCodeBenchCoding86.8%Pass@1UnverifiedNov 12, 2025Details
SciCodeCoding43.3%accuracyUnverifiedNov 12, 2025Details
MMMU (Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark)Multimodal85.4%accuracyUnverifiedNov 12, 2025Details
MultiChallengeReasoning63.41%accuracyVerifiedNov 12, 2025Details
OpenAI-MRCR v2 (Multi-Round Coreference Resolution)Reasoning61.6%accuracy (mean SequenceMatcher similarity)UnverifiedNov 12, 2025Details
Global-MMLUReasoning90.6%accuracyUnverifiedNov 12, 2025Details
WebDev ArenaChat preference1391EloVerifiedNov 12, 2025Details
Search ArenaChat preference1199EloVerifiedNov 12, 2025Details
Design ArenaChat preference1216EloVerifiedNov 12, 2025Details
MASK (Model Alignment between Statements and Knowledge)Other86.33Honesty scoreVerifiedNov 12, 2025Details
ScreenSpot-ProMultimodal3.5%accuracyVerifiedNov 12, 2025Details
FACTS GroundingReasoning50.0%Grounding accuracyVerifiedNov 12, 2025Details
EnigmaEvalReasoning11.23%accuracyVerifiedNov 12, 2025Details
ZeroBenchMultimodal5.0% (pass@5)accuracyVerifiedNov 12, 2025Details
FrontierMath Tier 4Reasoning12.5%accuracyOfficialNov 12, 2025Details
Vectara Hallucination LeaderboardOther12.1%Hallucination RateOfficialNov 12, 2025Details
Gray Swan Arena (Agent Red-Teaming / Indirect Prompt Injection)Agents2.5%Attack Success Rate (ASR)VerifiedNov 12, 2025Details
Vibe Code BenchCoding24.61%Overall accuracyVerifiedNov 12, 2025Details
GSO: Software Optimization Benchmark for SWE-AgentsCoding13.73%Opt@1OfficialNov 12, 2025Details
MultiNRCReasoning49.00%accuracyOfficialNov 12, 2025Details