Updated 6 h ago · first seen 11 Sept 2026
- Metric
- resolved · % ↑
- Current results
- 158
- Models
- 82
- Current leader
- gpt-4o 26.2%
Score history · gpt-4o 8 rows
- gpt-4o
- 21.62%date=2025-07-20 · board=Verified · system=mini-SWE-agent · model_tag=gpt-4o-2024112020 Jul 2025
- 38.8%date=2024-10-28 · board=Verified · system=Agentless-1.5 · model_tag=gpt-4o-2024-05-1328 Oct 2024
- 27%date=2024-10-16 · board=Verified · system=EPAM AI/Run Developer Agent · model_tag=gpt-4o-2024-08-0616 Oct 2024
- 24%date=2024-08-20 · board=Verified · system=EPAM AI/Run Developer Agent · model_tag=gpt-4o-2024-08-0620 Aug 2024
- 23.2%date=2024-07-28 · board=Verified · system=SWE-agent · model_tag=gpt-4o-2024-05-1328 Jul 2024
- 38.4%date=2024-06-28 · board=Verified · system=AutoCodeRover · model_tag=gpt-4o-2024-05-1328 Jun 2024
- 26.2%date=2024-06-15 · board=Verified · system=AppMap Navie · model_tag=gpt-4o-2024-05-1315 Jun 2024
- 32.6%date=2024-06-12 · board=Verified · system=MASAI · model_tag=gpt-4o-2024-08-0612 Jun 2024
Frontier over time · resolved · board=Verified · system=AppMap Navie
1 leader change recorded, all dated 15 Jun 2024 — the frontier line needs at least two distinct dates. The corpus is young: every result was first observed on the same day, so leader changes will separate in time as sources are re-crawled.
- 26.2%gpt-4o OpenAI Official board15 Jun 2024
Includes closed rows (history). A point is emitted whenever a result beats every earlier result of the same group, ordered by evaluated_at when the source publishes it, else observed_at.
Leaderboard 1 models
Select models with +, then Compare.
1 results
One row per canonical model — its best current row inside this comparability group (effort variants are folded into the model). Bars are relative to the page's best score. “vs leader” reads comparability: partially comparable = same task, conditions differ (reasoning effort, temperature, judge). Rules →