evals.report
BenchmarksLabsCompareRun guides

Vectara Hallucination Leaderboard

Measures how often LLMs introduce hallucinations when summarizing short documents, scored by Vectara's HHEM-2.3 factual-consistency model, reported as a hallucination rate.

OtherHallucination RateLower is better

What this benchmark measures

Measures how often LLMs introduce hallucinations when summarizing short documents, scored by Vectara's HHEM-2.3 factual-consistency model, reported as a hallucination rate.

Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.

The metric shown here is Hallucination Rate. It should be interpreted within Vectara Hallucination Leaderboard, not compared as part of a site-wide ranking.

No composite ranking
evals.report never combines benchmarks. Hallucination Rate on Vectara Hallucination Leaderboard is its own number — don’t average it with other metrics.