evals.report
BenchmarksLabsCompareRun guides
BenchmarksReasoning

IFBench

Ai2's instruction-following benchmark that measures precise instruction-following generalization on 58 diverse, verifiable out-of-domain output constraints designed to test whether models can obey novel rules rather than overfit to familiar constraint templates.

ReasoningaccuracyHigher is better

What this benchmark measures

Ai2's instruction-following benchmark that measures precise instruction-following generalization on 58 diverse, verifiable out-of-domain output constraints designed to test whether models can obey novel rules rather than overfit to familiar constraint templates.

Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.

The metric shown here is accuracy. It should be interpreted within IFBench, not compared as part of a site-wide ranking.

No composite ranking
evals.report never combines benchmarks. accuracy on IFBench is its own number — don’t average it with other metrics.