BenchmarksReasoning
AA-Omniscience v1.1: Knowledge and Hallucination Benchmark
Artificial Analysis' revised factual-knowledge and hallucination benchmark: 3,000 private questions across six major domains, down from 6,000 in v1. Saturated and public-set questions were removed, new questions were added, and ambiguous or erroneous ones were revised. Questions are drawn from authoritative academic and industry sources by an LLM-based question-generation agent. The Net Score (-100 to 100) rewards correct answers, penalizes hallucinated ones, and does not penalize abstaining.
ReasoningAA-Omniscience Net ScoreHigher is better
No run guide for this benchmark yet.