evals.report
BenchmarksLabsCompareRun guides
BenchmarksMultimodal

ZeroBench

An intentionally 'impossible' visual reasoning benchmark of 100 hand-crafted main questions (plus 334 subquestions) on which contemporary large multimodal models score near zero, designed to provide maximum headroom for measuring genuine multi-step visual understanding.

MultimodalaccuracyHigher is better

What this benchmark measures

An intentionally 'impossible' visual reasoning benchmark of 100 hand-crafted main questions (plus 334 subquestions) on which contemporary large multimodal models score near zero, designed to provide maximum headroom for measuring genuine multi-step visual understanding.

Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.

The metric shown here is accuracy. It should be interpreted within ZeroBench, not compared as part of a site-wide ranking.

No composite ranking
evals.report never combines benchmarks. accuracy on ZeroBench is its own number — don’t average it with other metrics.