SWE-bench Multimodal

Name: SWE-bench Multimodal
Creator: evals.report
License: https://creativecommons.org/licenses/by/4.0/

A software-engineering benchmark of 517 real GitHub issues from visual JavaScript/web projects that include visual context (screenshots, UI mockups, diagrams), measuring whether AI systems can resolve issues whose fixes are verified by the repository's tests.

Coding% resolvedHigher is better

Scores About Run this benchmark

No run guide for this benchmark yet.