evals.report
BenchmarksLabsCompareRun guides

AILuminate AI Safety Benchmark

MLCommons' standardized AI safety benchmark that grades how often general-purpose chat models produce policy-violating responses across 12 hazard categories (e.g. violent crimes, CSAM, hate, self-harm, specialized advice), assigning an ordinal safety grade from Poor to Excellent relative to a sub-15B open-weight reference system.

OtherSafety gradeHigher is better

What this benchmark measures

MLCommons' standardized AI safety benchmark that grades how often general-purpose chat models produce policy-violating responses across 12 hazard categories (e.g. violent crimes, CSAM, hate, self-harm, specialized advice), assigning an ordinal safety grade from Poor to Excellent relative to a sub-15B open-weight reference system.

Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.

The metric shown here is Safety grade. It should be interpreted within AILuminate AI Safety Benchmark, not compared as part of a site-wide ranking.

No composite ranking
evals.report never combines benchmarks. Safety grade on AILuminate AI Safety Benchmark is its own number — don’t average it with other metrics.