AIME (OTIS Mock)
Competition mathematics in the AIME format (Epoch AI's OTIS Mock AIME 2024-2025 set), a high-signal short-answer math reasoning benchmark.
What this benchmark measures
Competition mathematics in the AIME format (Epoch AI's OTIS Mock AIME 2024-2025 set), a high-signal short-answer math reasoning benchmark.
Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.
The metric shown here is accuracy. It should be interpreted within AIME (OTIS Mock), not compared as part of a site-wide ranking.
What to be careful about
AIME-style benchmarks are saturating at the top; keep effort/config attached.
Frequently asked
What is AIME (OTIS Mock)?
Competition mathematics in the AIME format (Epoch AI's OTIS Mock AIME 2024-2025 set), a high-signal short-answer math reasoning benchmark. It is a reasoning benchmark measured by accuracy.
What does accuracy mean on AIME (OTIS Mock)?
AIME (OTIS Mock) reports accuracy (%); higher is better. Scores are shown only within AIME (OTIS Mock) and are never averaged with other benchmarks.
What is the top reported AIME (OTIS Mock) score?
GPT-5.5 Pro has the top reported score on AIME (OTIS Mock): 100.0% (accuracy).
Why do AIME (OTIS Mock) scores differ across runs?
Harness, scaffold, reasoning effort, and prompt setup change results, so two runs of the same model can differ. evals.report keeps each score with its run context so the differences stay visible.
Does evals.report rank models across benchmarks?
No. AIME (OTIS Mock) scores are shown within their own metric; evals.report never combines benchmarks into a composite ranking or a single "best model".