evals.report
BenchmarksLabsCompareRun guides

SimpleQA Verified

A factual short-answer QA benchmark measuring parametric knowledge and hallucination resistance (Epoch AI's SimpleQA Verified).

OtheraccuracyHigher is better

What this benchmark measures

A factual short-answer QA benchmark measuring parametric knowledge and hallucination resistance (Epoch AI's SimpleQA Verified).

Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.

The metric shown here is accuracy. It should be interpreted within SimpleQA Verified, not compared as part of a site-wide ranking.

What to be careful about

Scores depend on grading strictness; keep the source methodology attached.

No composite ranking
evals.report never combines benchmarks. accuracy on SimpleQA Verified is its own number — don’t average it with other metrics.