evals.report
BenchmarksLabsCompareRun guides

OSWorld

OSWorld benchmarks multimodal AI agents on their ability to complete open-ended, real-world computer-use tasks (operating GUIs across web, files, and applications) in live operating-system environments via screenshots and mouse/keyboard control, measured by execution-based task success rate.

Agentstask success rateHigher is better

What this benchmark measures

OSWorld benchmarks multimodal AI agents on their ability to complete open-ended, real-world computer-use tasks (operating GUIs across web, files, and applications) in live operating-system environments via screenshots and mouse/keyboard control, measured by execution-based task success rate.

Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.

The metric shown here is task success rate. It should be interpreted within OSWorld, not compared as part of a site-wide ranking.

No composite ranking
evals.report never combines benchmarks. task success rate on OSWorld is its own number — don’t average it with other metrics.