EQ-Bench Creative Writing v3
An LLM-judged creative writing benchmark that scores models across 32 prompts (3 iterations each) using a hybrid of rubric scoring and pairwise Elo comparisons computed with a margin-weighted Glicko-2 rating system.
What this benchmark measures
An LLM-judged creative writing benchmark that scores models across 32 prompts (3 iterations each) using a hybrid of rubric scoring and pairwise Elo comparisons computed with a margin-weighted Glicko-2 rating system.
Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.
The metric shown here is Elo. It should be interpreted within EQ-Bench Creative Writing v3, not compared as part of a site-wide ranking.
Frequently asked
What is EQ-Bench Creative Writing v3?
An LLM-judged creative writing benchmark that scores models across 32 prompts (3 iterations each) using a hybrid of rubric scoring and pairwise Elo comparisons computed with a margin-weighted Glicko-2 rating system. It is a chat preference benchmark measured by Elo.
What does Elo mean on EQ-Bench Creative Writing v3?
EQ-Bench Creative Writing v3 reports Elo; higher is better. Scores are shown only within EQ-Bench Creative Writing v3 and are never averaged with other benchmarks.
What is the top reported EQ-Bench Creative Writing v3 score?
Claude Opus 4.7 has the top reported score on EQ-Bench Creative Writing v3: 2206 (Elo).
Why do EQ-Bench Creative Writing v3 scores differ across runs?
Harness, scaffold, reasoning effort, and prompt setup change results, so two runs of the same model can differ. evals.report keeps each score with its run context so the differences stay visible.
Does evals.report rank models across benchmarks?
No. EQ-Bench Creative Writing v3 scores are shown within their own metric; evals.report never combines benchmarks into a composite ranking or a single "best model".