evals.report
BenchmarksLabsCompareRun guides
BenchmarksMultimodal

MathVista

A benchmark of 6,141 examples (evaluated on the 1,000-example testmini split) that measures mathematical reasoning in visual contexts, spanning figure QA, geometry, math word problems, textbook QA, and visual QA, reported as answer accuracy.

MultimodalaccuracyHigher is better

What this benchmark measures

A benchmark of 6,141 examples (evaluated on the 1,000-example testmini split) that measures mathematical reasoning in visual contexts, spanning figure QA, geometry, math word problems, textbook QA, and visual QA, reported as answer accuracy.

Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.

The metric shown here is accuracy. It should be interpreted within MathVista, not compared as part of a site-wide ranking.

No composite ranking
evals.report never combines benchmarks. accuracy on MathVista is its own number — don’t average it with other metrics.