evals.report
BenchmarksLabsCompareRun guides
BenchmarksReasoning

MultiChallenge

A realistic multi-turn conversation benchmark by Scale AI (SEAL) that evaluates whether frontier LLMs can follow instructions, retain user information, perform versioned editing, and stay self-coherent across multiple conversational turns.

ReasoningaccuracyHigher is better

What this benchmark measures

A realistic multi-turn conversation benchmark by Scale AI (SEAL) that evaluates whether frontier LLMs can follow instructions, retain user information, perform versioned editing, and stay self-coherent across multiple conversational turns.

Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.

The metric shown here is accuracy. It should be interpreted within MultiChallenge, not compared as part of a site-wide ranking.

No composite ranking
evals.report never combines benchmarks. accuracy on MultiChallenge is its own number — don’t average it with other metrics.