IMO-Bench
A suite of IMO-level mathematical reasoning benchmarks from Google DeepMind, whose IMO-AnswerBench component tests models on 400 robustified Olympiad problems (Algebra, Combinatorics, Geometry, Number Theory) with verifiable short answers graded by an autograder.
What this benchmark measures
A suite of IMO-level mathematical reasoning benchmarks from Google DeepMind, whose IMO-AnswerBench component tests models on 400 robustified Olympiad problems (Algebra, Combinatorics, Geometry, Number Theory) with verifiable short answers graded by an autograder.
Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.
The metric shown here is accuracy. It should be interpreted within IMO-Bench, not compared as part of a site-wide ranking.
Frequently asked
What is IMO-Bench?
A suite of IMO-level mathematical reasoning benchmarks from Google DeepMind, whose IMO-AnswerBench component tests models on 400 robustified Olympiad problems (Algebra, Combinatorics, Geometry, Number Theory) with verifiable short answers graded by an autograder. It is a reasoning benchmark measured by accuracy.
What does accuracy mean on IMO-Bench?
IMO-Bench reports accuracy (%); higher is better. Scores are shown only within IMO-Bench and are never averaged with other benchmarks.
What is the top reported IMO-Bench score?
Grok 4 has the top reported score on IMO-Bench: 73.1% (accuracy).
Why do IMO-Bench scores differ across runs?
Harness, scaffold, reasoning effort, and prompt setup change results, so two runs of the same model can differ. evals.report keeps each score with its run context so the differences stay visible.
Does evals.report rank models across benchmarks?
No. IMO-Bench scores are shown within their own metric; evals.report never combines benchmarks into a composite ranking or a single "best model".