LabsMistral AI

Mistral AI

Track Mistral AI model scores across public AI benchmarks including GDPval-AA, BFCL, GPQA Diamond, AIME (OTIS Mock), and LMArena. Each result is shown one benchmark at a time, with source links and evaluation dates — no blended score or composite ranking. 2 models tracked, spanning Mistral and Mistral Medium.

2 models25 results mistral.ai

Models 2

Mistral Medium 3.5

Mistral Medium · mistral medium 3.5

2026-04-28

7 results

Mistral Large

Mistral · mistral-large

2024-02-26

18 results

Progress by benchmark

Show progress on

Mistral Large

Feb 26, 2024

864

Mistral Medium 3.5

Apr 28, 2026

1168+304.0

Single benchmark only

This view shows GDPval (Elo) only. Other benchmarks use different metrics and are not directly comparable.

Progress matrix

Model	SWE-bench Verified % resolved	Terminal-Bench 2.1 task success	DeepSWE % resolved	GPQA Diamond accuracy	LiveCodeBench Pro Codeforces Elo	Humanity's Last Exam accuracy	LiveBench score	SWE-bench Pro % resolved	Berkeley Function Calling Leaderboard accuracy	MMMU-Pro accuracy	LMArena source-defined rating	ARC-AGI-1 accuracy	ARC-AGI-2 accuracy	ARC-AGI-3 accuracy	FrontierMath accuracy	AIME (OTIS Mock) accuracy	SimpleQA Verified accuracy	GBA Eval overall score	WeirdML average accuracy	MCP Atlas pass rate	Remote Labor Index automation rate	Artificial Analysis Intelligence Index Index	Epoch Capabilities Index Index	Aider Polyglot % correct	SWE-rebench Resolved rate (pass@1)	MMLU-Pro accuracy	OSWorld task success rate	GAIA: A Benchmark for General AI Assistants accuracy	BrowseComp accuracy	τ²-bench (Telecom) pass^1	AIME 2026 accuracy	MathVista accuracy	Video-MME accuracy	GDPval Elo	LiveCodeBench Pass@1	METR Task-Completion Time Horizons 50% time horizon	SciCode accuracy	MMMU (Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark) accuracy	AA-Omniscience: Knowledge and Hallucination Benchmark AA-Omniscience Index	IFBench accuracy	MultiChallenge accuracy	OpenAI-MRCR v2 (Multi-Round Coreference Resolution) accuracy (mean SequenceMatcher similarity)	LongBench v2 accuracy	Global-MMLU accuracy	Video-MMMU accuracy	WebDev Arena Elo	Search Arena Elo	Arena-Hard-Auto v2.0 % win rate	EQ-Bench Creative Writing v3 Elo	Design Arena Elo	AILuminate AI Safety Benchmark Safety grade	MASK (Model Alignment between Statements and Knowledge) Honesty score	MCP-Universe Overall Success Rate	CharXiv accuracy	OCRBench v2 accuracy	ScreenSpot-Pro accuracy	FACTS Grounding Grounding accuracy	BigCodeBench calibrated Pass@1	SWE-bench Multilingual % resolved	SWE-bench Multimodal % resolved	SuperGPQA accuracy	EnigmaEval accuracy	ZeroBench accuracy	IMO-Bench accuracy	PutnamBench Problems solved	MathArena HMMT February 2026 accuracy	FrontierMath Tier 4 accuracy	Vectara Hallucination Leaderboard Hallucination Rate	Gray Swan Arena (Agent Red-Teaming / Indirect Prompt Injection) Attack Success Rate (ASR)	PolyMath: Evaluating Mathematical Reasoning in Multilingual Contexts Difficulty-Weighted Accuracy (DW-ACC)	Vibe Code Bench Overall accuracy	Online-Mind2Web Task success rate	WebArena Task success rate	GSO: Software Optimization Benchmark for SWE-Agents Opt@1	MultiNRC accuracy	Terminal-Bench 2.0 task success	SWE-Marathon resolution rate (pass@1)	FrontierCode weighted score (Diamond)	FrontierSWE dominance score	ProgramBench almost-resolved rate	CursorBench score	PostTrainBench weighted average score
Mistral Large Mistral	—	—	—	38.8%	—	—	—	—	38.37%	—	1265	—	—	—	—	1.9%	—	—	—	—	—	—	121.0	—	—	69.7%	—	—	—	—	—	—	—	864	17.8%	—	20.8%	—	—	—	—	—	39.6%	80.3%	—	1223	—	—	1402	—	Good	47.53	—	—	—	—	—	29.7%	—	—	40.65%	—	—	—	—	—	—	4.5%	—	—	—	—	—	—	—	—	—	—	—	—	—	—
Mistral Medium 3.5 Mistral Medium	77.6%	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	39.2	—	—	—	—	—	—	—	94.2%	—	—	—	1168	—	—	—	—	-36	68.8%	—	—	—	—	—	—	—	—	—	1176	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—

Scores are not normalised across benchmarks. Each column uses its own metric. Compare columns independently.

Mistral AI

Models 2

Progress by benchmark

Progress matrix

Related pages