BenchmarksReasoning
AIME (OTIS Mock)
Competition mathematics in the AIME format (Epoch AI's OTIS Mock AIME 2024-2025 set), a high-signal short-answer math reasoning benchmark.
ReasoningaccuracyHigher is better
What this benchmark measures
Competition mathematics in the AIME format (Epoch AI's OTIS Mock AIME 2024-2025 set), a high-signal short-answer math reasoning benchmark.
Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.
The metric shown here is accuracy. It should be interpreted within AIME (OTIS Mock), not compared as part of a site-wide ranking.
What to be careful about
AIME-style benchmarks are saturating at the top; keep effort/config attached.
No composite ranking
evals.report never combines benchmarks. accuracy on AIME (OTIS Mock) is its own number — don’t average it with other metrics.