evals.report
BenchmarksLabsCompareRun guidesIn the wild
BenchmarksReasoning

AA-Omniscience v1.1: Knowledge and Hallucination Benchmark

Artificial Analysis' revised factual-knowledge and hallucination benchmark: 3,000 private questions across six major domains, down from 6,000 in v1. Saturated and public-set questions were removed, new questions were added, and ambiguous or erroneous ones were revised. Questions are drawn from authoritative academic and industry sources by an LLM-based question-generation agent. The Net Score (-100 to 100) rewards correct answers, penalizes hallucinated ones, and does not penalize abstaining.

ReasoningAA-Omniscience Net ScoreHigher is better

No run guide for this benchmark yet.