evals.report
BenchmarksLabsCompareRun guidesIn the wild

GPT-4.1

OpenAI · GPT. Released Apr 14, 2025.

GPT-4.1 is a model from OpenAI in the GPT family, released Apr 14, 2025. evals.report tracks 34 reported GPT-4.1 benchmark scores across Berkeley Function Calling Leaderboard, SWE-bench Verified, GPQA Diamond, FrontierMath, AIME (OTIS Mock), LiveCodeBench Pro, WeirdML, Artificial Analysis Intelligence Index, and 26 more — each shown with its benchmark, metric, source status, and date, and never combined into a single ranking.

34 results

Benchmark results 34

Compare this model
BenchmarkCategoryScoreMetricStatusDate
Berkeley Function Calling LeaderboardTool use53.96%accuracyOfficialApr 14, 2025Details
SWE-bench VerifiedCoding48.5%% resolvedOfficialApr 14, 2025Details
GPQA DiamondReasoning66.9%accuracyOfficialApr 14, 2025Details
FrontierMathReasoning5.52%accuracyOfficialApr 14, 2025Details
AIME (OTIS Mock)Reasoning38.3%accuracyOfficialApr 14, 2025Details
LiveCodeBench ProCoding606Codeforces EloOfficialApr 14, 2025Details
WeirdMLCoding39.0%average accuracyOfficialApr 14, 2025Details
Artificial Analysis Intelligence IndexReasoning26.3IndexUnverifiedApr 14, 2025Details
Epoch Capabilities IndexReasoning137.6IndexOfficialApr 14, 2025Details
Aider PolyglotCoding52.4%% correctOfficialApr 14, 2025Details
MMLU-ProReasoning80.6%accuracyVerifiedApr 14, 2025Details
GAIA: A Benchmark for General AI AssistantsAgents50.30%accuracyUnverifiedApr 14, 2025Details
τ²-bench (Telecom)Tool use34%pass^1VerifiedApr 14, 2025Details
MathVistaMultimodal72.2%accuracyVerifiedApr 14, 2025Details
GDPvalAgents776EloOfficialApr 14, 2025Details
LiveCodeBenchCoding45.7%Pass@1UnverifiedApr 14, 2025Details
SciCodeCoding38.1%accuracyUnverifiedApr 14, 2025Details
MMMU (Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark)Multimodal74.8%accuracyUnverifiedApr 14, 2025Details
MultiChallengeReasoning39.43%accuracyVerifiedApr 14, 2025Details
Arena-Hard-Auto v2.0Chat preference50.0%% win rateOfficialApr 14, 2025Details
EQ-Bench Creative Writing v3Chat preference1419EloVerifiedApr 14, 2025Details
Design ArenaChat preference1080EloVerifiedApr 14, 2025Details
MASK (Model Alignment between Statements and Knowledge)Other51.13Honesty scoreVerifiedApr 14, 2025Details
MCP-UniverseTool use19.91%Overall Success RateVerifiedApr 14, 2025Details
CharXivMultimodal56.7%accuracyUnverifiedApr 14, 2025Details
FACTS GroundingReasoning45.6%Grounding accuracyVerifiedApr 14, 2025Details
BigCodeBenchCoding33.8%calibrated Pass@1VerifiedApr 14, 2025Details
SWE-bench MultimodalCoding31.14%% resolvedVerifiedApr 14, 2025Details
EnigmaEvalReasoning2.17%accuracyVerifiedApr 14, 2025Details
ZeroBenchMultimodal0.0% (pass@1)accuracyVerifiedApr 14, 2025Details
Vectara Hallucination LeaderboardOther5.6%Hallucination RateOfficialApr 14, 2025Details
PolyMath: Evaluating Mathematical Reasoning in Multilingual ContextsReasoning26.4Difficulty-Weighted Accuracy (DW-ACC)VerifiedApr 14, 2025Details
Online-Mind2WebAgents36.33%Task success rateVerifiedApr 14, 2025Details
MultiNRCReasoning21.23%accuracyOfficialApr 14, 2025Details