Skip to content
AI Atlas
BenchmarkActive

SWE-bench Multimodal

swebench.com/multimodal

resolve visual JavaScript issues (screenshots + code)

data quality57

Updated 15 h ago · first seen 11 Sept 2026

Metric
· %
Current results
0
Models
0
Current leader
o3 36.0%

No results recorded for this benchmark yet — its sources are being connected. The definition, aliases and variants are kept so links resolve; nothing is fabricated.

Leaderboard 4 models

Select models with +, then Compare.

Leaderboard
#ModelScoreTrustConfigurationvs leaderEvaluatedSourceActions
1o3ClosedOpenAI · OpenAI o-series36.0%Official boardgroup defaultsleader1 Jul 2025swebench.comT2History
2o4-miniClosedOpenAI · OpenAI o-series33.9%Official boardgroup defaultsPartially comparable-2.13 pt31 May 2025swebench.comT2History
3gpt-4.1ClosedOpenAI · GPT 4.131.1%Official boardgroup defaultsPartially comparable-4.84 pt31 May 2025swebench.comT2History
4gpt-4oClosedOpenAI · GPT 430.4%Official boardgroup defaultsPartially comparable-5.61 pt31 May 2025swebench.comT2History

4 results

One row per canonical model — its best current row inside this comparability group (effort variants are folded into the model). Bars are relative to the page's best score. “vs leader” reads comparability: partially comparable = same task, conditions differ (reasoning effort, temperature, judge). Rules →