evals.report
BenchmarksLabsCompareRun guidesIn the wild
BenchmarksReasoning

AA-Omniscience: Knowledge and Hallucination Benchmark

A factuality and knowledge benchmark of 6,000 questions across 42 economically relevant topics in six domains, scoring models on the AA-Omniscience Index (-100 to 100) that rewards correct answers, penalizes hallucinations, and applies no penalty for abstaining.

ReasoningAA-Omniscience IndexHigher is better
ScoresAboutRun this benchmark

What is AA-Omniscience: Knowledge and Hallucination Benchmark?

A factuality and knowledge benchmark of 6,000 questions across 42 economically relevant topics in six domains, scoring models on the AA-Omniscience Index (-100 to 100) that rewards correct answers, penalizes hallucinations, and applies no penalty for abstaining. evals.report tracks reported AA-Omniscience: Knowledge and Hallucination Benchmark scores with the model, source, status, date, and run caveats attached — official leaderboard scores, vendor-reported launches, and clearly labeled community runs.

Top reported AA-Omniscience: Knowledge and Hallucination Benchmark score: Claude Opus 5.5 — 46 (AA-Omniscience Index).

ModelLabScore↓Source modelStatusDate
Claude Opus 5.5Anthropic46Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback)OfficialSep 22, 2026Details
GPT-6 AstraOpenAI44GPT-6 Astra (high)OfficialSep 3, 2026Details
Claude Fable 5Anthropic43Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)OfficialJun 9, 2026Details
Claude Fable 5.1Anthropic43Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)OfficialSep 1, 2026Details
Claude Opus 5Anthropic37Claude Opus 5 (Adaptive Reasoning, Max Effort)OfficialJul 24, 2026Details
Gemini 3.1 Pro PreviewGoogle DeepMind33—OfficialFeb 19, 2026Details
Grok 4.7xAI32Grok 4.7 (xhigh)OfficialSep 21, 2026Details
Grok 4.6xAI30Grok 4.6 (high)OfficialAug 12, 2026Details
Gemini 3.8 FlashGoogle DeepMind30Gemini 3.8 Flash (high)OfficialSep 2, 2026Details
GPT-6 SolOpenAI27GPT-6 Sol (max)OfficialSep 22, 2026Details
Claude Opus 4.8Anthropic27—OfficialMay 28, 2026Details
Claude Opus 4.7Anthropic26—OfficialApr 16, 2026Details
Muse Spark 1.3Meta25Muse Spark 1.3 (max)OfficialSep 2, 2026Details
Gemini 3.5 FlashGoogle DeepMind23—OfficialMay 19, 2026Details
GPT-5.6 SolOpenAI22GPT-5.6 Sol (max)OfficialJul 9, 2026Details
Kimi K3OpenMoonshot AI20Kimi K3 (max)OfficialJul 16, 2026Details
GPT-5.5OpenAI20—OfficialApr 23, 2026Details
Grok 4.3xAI18—OfficialApr 17, 2026Details
Step 5 PreviewStepFun16Step 5 PreviewOfficialSep 18, 2026Details
GLM-5.3OpenZ.ai14GLM-5.3 (max)OfficialAug 14, 2026Details
Qwen3.8 Max (0902)Alibaba / Qwen12Qwen3.8 Max (0902)OfficialSep 2, 2026Details
Claude Sonnet 4.6Anthropic12—OfficialFeb 17, 2026Details
MiMo-V2.6-ProOpenXiaomi8MiMo-V2.6-ProOfficialSep 21, 2026Details
GLM-5.3-FlashOpenZ.ai7GLM-5.3-FlashOfficialAug 26, 2026Details
Kimi K2.6OpenMoonshot AI6—OfficialApr 20, 2026Details
GPT-5.4OpenAI6—OfficialMar 5, 2026Details
Gemini 3.5 Flash-LiteGoogle DeepMind5Gemini 3.5 Flash-LiteOfficialJul 21, 2026Details
Qwen3.8 MaxAlibaba / Qwen4Qwen3.8 2.4T A95BOfficialAug 3, 2026Details
Muse SparkMeta4—OfficialApr 8, 2026Details
MiMo-V2.5-ProOpenXiaomi4—OfficialApr 22, 2026Details
InklingOpenThinking Machines Lab2Inkling (xhigh)OfficialJul 15, 2026Details
GLM-5.1OpenZ.ai2—OfficialApr 7, 2026Details
GPT-6 LunaOpenAI1GPT-6 Luna (max)OfficialSep 22, 2026Details
MiniMax M3OpenMiniMax1MiniMax-M3OfficialJun 1, 2026Details
DeepSeek V4 Pro 0813OpenDeepSeek1DeepSeek V4 Pro 0813 (Reasoning, Max Effort)OfficialAug 13, 2026Details
MiniMax M2.7OpenMiniMax1—OfficialMar 18, 2026Details
NVIDIA Nemotron 3 UltraOpenNVIDIA0Nemotron 3 Ultra 550B A55B (Reasoning)OfficialJun 4, 2026Details
GPT-5.6 TerraOpenAI0GPT-5.6 Terra (max)OfficialJul 9, 2026Details
K2 Horizon 375B A23BOpenMBZUAI-3K2 Horizon 375B A23BOfficialSep 3, 2026Details
Claude Haiku 4.5Anthropic-4—OfficialOct 15, 2025Details
DeepSeek V4.1 FlashOpenDeepSeek-5DeepSeek V4.1 Flash (Reasoning, Max Effort)OfficialSep 10, 2026Details
Qwen3.8-27BOpenAlibaba / Qwen-10Qwen3.8 27B (xhigh)OfficialAug 5, 2026Details
GPT-5.6 LunaOpenAI-10GPT-5.6 Luna (max)OfficialJul 9, 2026Details
DeepSeek V4 ProOpenDeepSeek-10—OfficialApr 24, 2026Details
Llama 3.1 405BOpenMeta-17—OfficialJul 23, 2024Details
DeepSeek V4 FlashOpenDeepSeek-23—OfficialApr 24, 2026Details
Qwen3.5-397B-A17BOpenAlibaba / Qwen-30—OfficialFeb 16, 2026Details
Muse Glimmer 30BOpenMeta-33Muse Glimmer (high)OfficialAug 10, 2026Details
Mistral Medium 3.5Mistral AI-37Mistral Medium 3.5OfficialApr 28, 2026Details
NVIDIA Nemotron 3 Super 120B-A12BOpenNVIDIA-42—OfficialMar 10, 2026Details
GPT-OSS-120BOpenOpenAI-49gpt-oss-120b (high)OfficialAug 5, 2025Details

Each row reports the model’s AA-Omniscience Index on AA-Omniscience: Knowledge and Hallucination Benchmark. Click a row for the full run context.