Run guidesReasoning
Run ARC-AGI-2
The same run guide is also available from the benchmark detail page.
Reasoningaccuracy
Tasks and evaluation are public; frontier scores are ARC-Prize-verified.
1Expected output
Use the official source links for current output format, submission steps, and benchmark-specific result files.
2Submit results
Keep source URL, source model name, benchmark version, harness, and run context attached to any reported score.
Gotchas
Public and semi-private splits differ; keep the reported effort/compute as run context.
Do not mix this benchmark's metric with unrelated benchmark metrics.