Skip to content
AI Atlas
BenchmarkActivecategory · codingfamily · swe-bench · variant Verified

SWE-bench Verified

swebench.com

resolve real GitHub issues (500 human-validated instances)

data quality57

Updated 6 h ago · first seen 11 Sept 2026

Metric
resolved · %
Current results
158
Models
82
Current leader
gpt-4o 38.4%

Frontier over time · resolved · board=Verified · system=AutoCodeRover

1 leader change recorded, all dated 28 Jun 2024 — the frontier line needs at least two distinct dates. The corpus is young: every result was first observed on the same day, so leader changes will separate in time as sources are re-crawled.

  1. 38.4%gpt-4o OpenAI Community28 Jun 2024

Includes closed rows (history). A point is emitted whenever a result beats every earlier result of the same group, ordered by evaluated_at when the source publishes it, else observed_at.

Leaderboard 1 models · trust community

Select models with +, then Compare.

Leaderboard
#ModelScoreTrustConfigurationvs leaderEvaluatedSourceActions
1gpt-4oClosedOpenAI · GPT 438.4%Communitygroup defaultsleader28 Jun 2024swebench.comT2History

1 results

One row per canonical model — its best current row inside this comparability group (effort variants are folded into the model). Bars are relative to the page's best score. “vs leader” reads comparability: partially comparable = same task, conditions differ (reasoning effort, temperature, judge). Rules →