evals.report
BenchmarksLabsCompareRun guides
BenchmarksReasoning

AA-Omniscience: Knowledge and Hallucination Benchmark

A factuality and knowledge benchmark of 6,000 questions across 42 economically relevant topics in six domains, scoring models on the AA-Omniscience Index (-100 to 100) that rewards correct answers, penalizes hallucinations, and applies no penalty for abstaining.

ReasoningAA-Omniscience IndexHigher is better
ScoresAboutRun this benchmark
ModelLabScore↓Source modelStatusDate
Gemini 3.1 Pro PreviewGoogle DeepMind33—OfficialFeb 19, 2026Details
Claude Opus 4.8Anthropic27—OfficialMay 28, 2026Details
Claude Opus 4.7Anthropic26—OfficialApr 16, 2026Details
Gemini 3.5 FlashGoogle DeepMind23—OfficialMay 19, 2026Details
GPT-5.5OpenAI20—OfficialApr 23, 2026Details
Grok 4.3xAI18—OfficialApr 17, 2026Details
Claude Sonnet 4.6Anthropic12—OfficialFeb 17, 2026Details
Kimi K2.6Moonshot AI6—OfficialApr 20, 2026Details
GPT-5.4OpenAI6—OfficialMar 5, 2026Details
Muse SparkMeta4—OfficialApr 8, 2026Details
MiMo-V2.5-ProXiaomi4—OfficialApr 22, 2026Details
GLM-5.1Z.ai2—OfficialApr 7, 2026Details
MiniMax M2.7MiniMax1—OfficialMar 18, 2026Details
Claude Haiku 4.5Anthropic-4—OfficialOct 15, 2025Details
DeepSeek V4 ProDeepSeek-10—OfficialApr 24, 2026Details
Llama 3.1 405BMeta-17—OfficialJul 23, 2024Details
DeepSeek V4 FlashDeepSeek-23—OfficialApr 24, 2026Details
Qwen3.5-397B-A17BAlibaba / Qwen-30—OfficialFeb 16, 2026Details
Mistral Medium 3.5Mistral AI-36—OfficialApr 28, 2026Details
NVIDIA Nemotron 3 Super 120B-A12BNVIDIA-42—OfficialMar 10, 2026Details
GPT-OSS-120BOpenAI-50—OfficialAug 5, 2025Details

Each row reports the model’s AA-Omniscience Index on AA-Omniscience: Knowledge and Hallucination Benchmark. Click a row for the full run context.