evals.report
BenchmarksLabsCompareRun guides

Vibe Code Bench

An end-to-end web application development benchmark (by Vals AI / Replit) where models build complete full-stack web apps from natural-language specifications in a sandboxed environment with production services (Supabase, Stripe, email), then are scored by an autonomous browser agent on overall application pass accuracy.

CodingOverall accuracyHigher is better

What this benchmark measures

An end-to-end web application development benchmark (by Vals AI / Replit) where models build complete full-stack web apps from natural-language specifications in a sandboxed environment with production services (Supabase, Stripe, email), then are scored by an autonomous browser agent on overall application pass accuracy.

Rows on this page are sourced from public benchmark artifacts, leaderboard exports, or source-linked model reports. Each row keeps benchmark version, source model name, and available run details attached to the score.

The metric shown here is Overall accuracy. It should be interpreted within Vibe Code Bench, not compared as part of a site-wide ranking.

No composite ranking
evals.report never combines benchmarks. Overall accuracy on Vibe Code Bench is its own number — don’t average it with other metrics.