Skip to content
AI Atlas
BenchmarkActivecategory · coding

SWE-bench Verified

swebench.com

resolve real GitHub issues (500 human-validated instances)

quality57

Updated 7 h ago · first seen 11 Sept 2026

bench_01M293SPEGA1XMKH0SMTFTCK2R

Metric
resolved · %
Direction
Higher is better
Results
180
Leader
Claude Opus 4.5 79.2%

Score history · GLM 4.5 2 rows

0%20%40%60%80%Aug 25Aug 25Aug 25
  • GLM 4.5
  • 54.2%date=2025-08-22 · board=Verified · system=mini-SWE-agent · model_tag=GLM-4.522 Aug 2025
  • 64.2%date=2025-07-28 · board=Verified · system=Undisclosed · model_tag=https://huggingface.co/zai-org/GLM-4.528 Jul 2025

Back to the full leaderboard

Leaderboard 180 current results

Select models with +, then open Compare.

Leaderboard
#ModelScoreConfigEvaluatedSourceActions
1#1Claude Opus 4.5Anthropic79.2%date=2025-12-15 · board=Verified · system=live-SWE-agent · model_tag=claude-opus-4-5-2025110115 Dec 2025swebench.comT2 History
2#2Claude Opus 4.5Anthropic79.2%date=2025-12-05 · board=Verified · system=Sonar Foundation Agent · model_tag=claude-opus-4-55 Dec 2025swebench.comT2 History
3#3doubao-seed-codeByteDance78.8%date=2025-09-28 · board=Verified · system=TRAE · model_tag=Doubao-Seed-Code28 Sept 2025swebench.comT2 History
4#4Gemini 3 Pro PreviewGoogle77.4%date=2025-11-20 · board=Verified · system=live-SWE-agent · model_tag=gemini-3-pro-preview20 Nov 2025swebench.comT2 History
5#5Claude 4 SonnetAnthropic76.8%date=2025-08-04 · board=Verified · system=EPAM AI/Run Developer Agent · model_tag=claude-sonnet-4-202505144 Aug 2025swebench.comT2 History
6#6Claude Opus 4.5Anthropic76.8%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=claude-4-5-opus17 Feb 2026swebench.comT2 History
7#7MultipleAnthropic76.8%date=2025-09-02 · board=Verified · system=Atlassian Rovo Dev · model_tag=claude-sonnet-4-202505142 Sept 2025swebench.comT2 History
8#8MultipleAnthropic76.4%date=2025-08-19 · board=Verified · system=ACoder · model_tag=claude-4-sonnet19 Aug 2025swebench.comT2 History
9#9MiniMax M2.5MiniMax75.8%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=minimax-m2.517 Feb 2026swebench.comT2 History
10#10gemini-3-flashGoogle75.8%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=gemini-3-flash-preview17 Feb 2026swebench.comT2 History
11#11MultipleAnthropic75.6%date=2025-09-01 · board=Verified · system=Warp · model_tag=gpt-51 Sept 2025swebench.comT2 History
12#12Claude Opus 4.6Anthropic75.6%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=claude-opus-4-617 Feb 2026swebench.comT2 History
13#13MultipleAnthropic75.2%date=2025-06-12 · board=Verified · system=TRAE · model_tag=claude-4-sonnet-2025052212 Jun 2025swebench.comT2 History
14#14Claude 4.5 SonnetAnthropic74.8%date=2025-11-03 · board=Verified · system=Sonar Foundation Agent · model_tag=claude-sonnet-4-53 Nov 2025swebench.comT2 History
15#15Claude Sonnet 4Anthropic74.8%date=2025-07-31 · board=Verified · system=Harness AI · model_tag=claude-sonnet-4-2025051431 Jul 2025swebench.comT2 History
16#16MultipleAnthropic74.6%date=2025-09-15 · board=Verified · system=JoyCode · model_tag=claude-4-sonnet15 Sept 2025swebench.comT2 History
17#17Claude 4 SonnetAnthropic74.6%date=2025-07-20 · board=Verified · system=Lingxi-v1.5 · model_tag=claude-4-sonnet-2025051420 Jul 2025swebench.comT2 History
18#18gpt-5OpenAI74.4%date=2025-10-15 · board=Verified · system=Prometheus-v1.2.1 · model_tag=gpt-5-2025-08-0715 Oct 2025swebench.comT2 History
19#19Claude Opus 4.5Anthropic74.4%date=2025-11-24 · board=Verified · system=mini-SWE-agent · model_tag=claude-opus-4-5-2025110124 Nov 2025swebench.comT2 History
20#20MultipleAnthropic74.4%date=2025-06-03 · board=Verified · system=Refact.ai Agent · model_tag=claude-4-sonnet3 Jun 2025swebench.comT2 History
21#21Gemini 3 Pro PreviewGoogle74.2%date=2025-11-18 · board=Verified · system=mini-SWE-agent · model_tag=gemini-3-pro-preview18 Nov 2025swebench.comT2 History
22#22MultipleAnthropic73.8%date=2025-11-03 · board=Verified · system=Salesforce AI Research SAGE · model_tag=claude-sonnet-4.53 Nov 2025swebench.comT2 History
23#23claude-4-opusAnthropic73.2%date=2025-05-22 · board=Verified · system=Tools · model_tag=claude-4-opus-2025051422 May 2025swebench.comT2 History
24#24MultipleAnthropic73%date=2025-10-21 · board=Verified · system=Salesforce AI Research SAGE · model_tag=claude-sonnet-4.521 Oct 2025swebench.comT2 History
25#25GPT-5.2-CodexOpenAI72.8%date=2026-02-19 · board=Verified · system=mini-SWE-agent · model_tag=gpt-5-2-codex19 Feb 2026swebench.comT2 History
26#26gpt-5.2OpenAI72.8%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=gpt-5-217 Feb 2026swebench.comT2 History
27#27GLM 5Z.ai (Zhipu AI)72.8%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=glm-517 Feb 2026swebench.comT2 History
28#28Claude 4 SonnetAnthropic72.4%date=2025-05-22 · board=Verified · system=Tools · model_tag=claude-4-sonnet-2025051422 May 2025swebench.comT2 History
29#29gpt-5OpenAI71.8%date=2025-08-07 · board=Verified · system=OpenHands · model_tag=openai/gpt-5-2025-08-077 Aug 2025swebench.comT2 History
30#30gpt-5.2OpenAI71.8%date=2025-12-11 · board=Verified · system=mini-SWE-agent · model_tag=gpt-5.2-2025-12-1111 Dec 2025swebench.comT2 History
31#31Claude 4.5 SonnetAnthropic71.4%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=claude-sonnet-4-5-2025092917 Feb 2026swebench.comT2 History
32#32Claude 4 SonnetAnthropic71.2%date=2025-07-10 · board=Verified · system=Bloop · model_tag=claude-4-sonnet-2025051410 Jul 2025swebench.comT2 History
33#33Kimi K2 0711Moonshot AI71.2%date=2025-10-14 · board=Verified · system=Lingxi v1.5 · model_tag=kimi-k2-0905-preview14 Oct 2025swebench.comT2 History
34#34gpt-5OpenAI71.2%date=2025-09-29 · board=Verified · system=Prometheus-v1.2 · model_tag=gpt-5-2025-08-0729 Sept 2025swebench.comT2 History
35#35MultipleAnthropic71.2%date=2025-07-15 · board=Verified · system=Qodo Command · model_tag=claude-sonnet-4-2025051415 Jul 2025swebench.comT2 History
36#36MultipleAnthropic71%date=2025-06-23 · board=Verified · system=Warp · model_tag=claude-sonnet-4-2025051423 Jun 2025swebench.comT2 History
37#37Kimi K2.5Moonshot AI70.8%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=kimi-k2.517 Feb 2026swebench.comT2 History
38#38Claude 4 SonnetAnthropic70.8%date=2025-06-11 · board=Verified · system=Moatless Tools · model_tag=claude-4-sonnet-2025051411 Jun 2025swebench.comT2 History
39#39Claude 4.5 SonnetAnthropic70.6%date=2025-09-29 · board=Verified · system=mini-SWE-agent · model_tag=claude-sonnet-4-5-2025092929 Sept 2025swebench.comT2 History
40#40Undisclosed70.6%date=2025-05-19 · board=Verified · system=TRAE · submission=20250519_trae19 May 2025swebench.comT2 History
41#41Claude 4 SonnetAnthropic70.4%date=2025-05-24 · board=Verified · system=OpenHands · model_tag=claude-4-sonnet-2025051424 May 2025swebench.comT2 History
42#42Undisclosed70.4%date=2025-06-10 · board=Verified · system=Augment Agent v1 · submission=20250610_augment_agent_v110 Jun 2025swebench.comT2 History
43#43MultipleAnthropic70.4%date=2025-05-15 · board=Verified · system=Refact.ai Agent · model_tag=claude-3-7-sonnet-2025021915 May 2025swebench.comT2 History
44#44MultipleAnthropic70.2%date=2025-05-19 · board=Verified · system=devlo · model_tag=claude-3-7-sonnet-2025021919 May 2025swebench.comT2 History
45#45DeepSeek V3.2DeepSeek70%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=deepseek-v3.217 Feb 2026swebench.comT2 History
46#46MultipleAnthropic70%date=2025-04-30 · board=Verified · system=Zencoder · model_tag=claude-3-7-sonnet-2025021930 Apr 2025swebench.comT2 History
47#47gemini-3-proGoogle69.6%date=2026-02-26 · board=Verified · system=mini-SWE-agent · model_tag=gemini-3-pro-preview26 Feb 2026swebench.comT2 History
48#48qwen3-coder-480b-a35b-instructAlibaba Group69.6%date=2025-08-05 · board=Verified · system=OpenHands · model_tag=https://huggingface.co/Qwen/Qwen3-Coder-480B-A35B-Instruct5 Aug 2025swebench.comT2 History
49#49gpt-5.2OpenAI69%date=2025-12-11 · board=Verified · system=mini-SWE-agent · model_tag=gpt-5.2-2025-12-1111 Dec 2025swebench.comT2 History
50#50MultipleAnthropic68.2%date=2025-05-16 · board=Verified · system=Nemotron-CORTEXA · model_tag=NV-EmbedCode16 May 2025swebench.comT2 History
51#51GLM 4.6Z.ai (Zhipu AI)68.2%date=2025-09-30 · board=Verified · system=Undisclosed · model_tag=https://huggingface.co/zai-org/GLM-4.630 Sept 2025swebench.comT2 History
52#52claude-4-opusAnthropic67.6%date=2025-08-02 · board=Verified · system=mini-SWE-agent · model_tag=claude-4-opus-202505142 Aug 2025swebench.comT2 History
53#53Claude 4 SonnetAnthropic66.6%date=2025-05-22 · board=Verified · system=SWE-agent · model_tag=claude-4-sonnet-2025051422 May 2025swebench.comT2 History
54#54Claude 4.5 HaikuAnthropic66.6%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=claude-haiku-4-5-2025100117 Feb 2026swebench.comT2 History
55#55Claude 3.7 SonnetAnthropic66.4%date=2025-05-14 · board=Verified · system=Aime-coder v1 · model_tag=claude-3-7-sonnet-2025021914 May 2025swebench.comT2 History
56#56gpt-5.1OpenAI66%date=2025-11-20 · board=Verified · system=mini-SWE-agent · model_tag=gpt-5.1-2025-11-1320 Nov 2025swebench.comT2 History
57#57GPT-5.1-CodexOpenAI66%date=2025-11-24 · board=Verified · system=mini-SWE-agent · model_tag=gpt-5.1-codex24 Nov 2025swebench.comT2 History
58#58Undisclosed65.8%date=2025-04-15 · board=Verified · system=OpenHands · submission=20250415_openhands15 Apr 2025swebench.comT2 History
59#59Undisclosed65.4%date=2025-04-05 · board=Verified · system=Amazon Q Developer Agent · submission=20250405_amazon-q-developer-agent-20250405-dev5 Apr 2025swebench.comT2 History
60#60Kimi K2 0711Moonshot AI65.4%date=2025-07-16 · board=Verified · system=OpenHands · model_tag=moonshot/kimi-k2-0711-preview16 Jul 2025swebench.comT2 History
61#61Undisclosed65.4%date=2025-03-16 · board=Verified · system=Augment Agent v0 · submission=20250316_augment_agent_v016 Mar 2025swebench.comT2 History
62#62gpt-5OpenAI65%date=2025-08-07 · board=Verified · system=mini-SWE-agent · model_tag=gpt-5-2025-08-077 Aug 2025swebench.comT2 History
63#63Claude 4 SonnetAnthropic64.93%date=2025-07-26 · board=Verified · system=mini-SWE-agent · model_tag=claude-4-sonnet-2025051426 Jul 2025swebench.comT2 History
64#64o4-miniOpenAI64.6%date=2025-05-03 · board=Verified · system=PatchPilot-v1.1 · model_tag=o4-mini3 May 2025swebench.comT2 History
65#65o1 PreviewOpenAI64.6%date=2025-01-17 · board=Verified · system=W&B Programmer O1 crosscheck5 · model_tag=o1-preview17 Jan 2025swebench.comT2 History
66#66GLM 4.5Z.ai (Zhipu AI)64.2%date=2025-07-28 · board=Verified · system=Undisclosed · model_tag=https://huggingface.co/zai-org/GLM-4.528 Jul 2025swebench.comT2 History
67#67claude-35-sonnetAnthropic63.4%date=2025-02-06 · board=Verified · system=AgentScope · model_tag=claude-3-5-sonnet-202410226 Feb 2025swebench.comT2 History
68#68Kimi K2 ThinkingMoonshot AI63.4%date=2025-12-10 · board=Verified · system=mini-SWE-agent · model_tag=Kimi-K2-Thinking10 Dec 2025swebench.comT2 History
69#69Claude 3.7 SonnetAnthropic63.2%date=2025-02-24 · board=Verified · system=Tools · submission=20250224_tools_claude-3-7-sonnet24 Feb 2025swebench.comT2 History
70#70claude-35-sonnetAnthropic62.8%date=2025-02-28 · board=Verified · system=EPAM AI/Run Developer Agent · model_tag=claude-3-5-sonnet-2024102228 Feb 2025swebench.comT2 History
71#71Undisclosed62.8%date=2025-01-10 · board=Verified · system=Blackbox AI Agent · submission=20250110_blackboxai_agent_v1.110 Jan 2025swebench.comT2 History
72#72Claude 3.7 Sonnet w/ Review HeavyAnthropic62.4%date=2025-02-25 · board=Verified · system=SWE-agent · model_tag=claude-3-7-sonnet-2025021925 Feb 2025swebench.comT2 History
73#73swe-searchAnthropic62.2%date=2024-12-21 · board=Verified · system=CodeStory Midwit Agent · model_tag=claude-3-5-sonnet-2024102221 Dec 2024swebench.comT2 History
74#74MiniMax M2MiniMax61%date=2025-11-24 · board=Verified · system=mini-SWE-agent · model_tag=minimax-m224 Nov 2025swebench.comT2 History
75#754x Scaled60.8%date=2025-02-03 · board=Verified · system=OpenHands · submission=20250203_openhands_4x_scaled3 Feb 2025swebench.comT2 History
76#76Qwen3 Coder 30B A3B InstructQwen60.4%date=2025-09-01 · board=Verified · system=EntroPO + R2E · model_tag=Qwen3-Coder-30B-A3B-Instruct1 Sept 2025swebench.comT2 History
77#77claude-35-sonnetAnthropic60.2%date=2025-01-10 · board=Verified · system=Learn-by-interact · model_tag=claude-3-5-sonnet-2024102210 Jan 2025swebench.comT2 History
78#78DeepSeek V3.2 ReasonerDeepSeek60%date=2025-12-01 · board=Verified · system=mini-SWE-agent · model_tag=deepseek-v3.2-reasoner1 Dec 2025swebench.comT2 History
79#79gpt-5-miniOpenAI59.8%date=2025-08-07 · board=Verified · system=mini-SWE-agent · model_tag=gpt-5-mini-2025-08-077 Aug 2025swebench.comT2 History
80#80TTS(Bo16)OpenAI58.8%date=2025-06-29 · board=Verified · system=DeepSWE-Preview · model_tag=https://huggingface.co/agentica-org/DeepSWE-Preview29 Jun 2025swebench.comT2 History
81#81o3OpenAI58.4%date=2025-07-26 · board=Verified · system=mini-SWE-agent · model_tag=o3-2025041626 Jul 2025swebench.comT2 History
82#82Undisclosed58.2%date=2024-12-13 · board=Verified · system=devlo · submission=20241213_devlo13 Dec 2024swebench.comT2 History
83#83MultipleAnthropic58.2%date=2025-04-10 · board=Verified · system=Nemotron-CORTEXA · model_tag=NV-EmbedCode10 Apr 2025swebench.comT2 History
84#84MultipleAnthropic57.2%date=2024-12-23 · board=Verified · system=Emergent E1 · model_tag=claude-3-5-sonnet-2024102223 Dec 2024swebench.comT2 History
85#85Undisclosed57%date=2024-12-08 · board=Verified · system=Gru · submission=20241208_gru8 Dec 2024swebench.comT2 History
86#86Claude Sonnet 4Anthropic57%date=2025-09-24 · board=Verified · system=Artemis Agent v2 · model_tag=claude-sonnet-4-2025051424 Sept 2025swebench.comT2 History
87#87Undisclosed56.6%date=2025-04-05 · board=Verified · system=SWE-Rizzo · submission=20250405_swe-rizzo_claude375 Apr 2025swebench.comT2 History
88#88Devstral Small (2512)Mistral AI56.4%date=2025-12-09 · board=Verified · system=mini-SWE-agent · model_tag=devstral-small-25129 Dec 2025swebench.comT2 History
89#89gpt-5-miniOpenAI56.2%date=2026-02-17 · board=Verified · system=mini-SWE-agent · model_tag=gpt-5-mini-2025-08-0717 Feb 2026swebench.comT2 History
90#90GLM 4.6Z.ai (Zhipu AI)55.4%date=2025-12-01 · board=Verified · system=mini-SWE-agent · model_tag=glm-4.61 Dec 2025swebench.comT2 History
91#91claude-35-sonnetAnthropic55.4%date=2024-12-12 · board=Verified · system=EPAM AI/Run Developer Agent · model_tag=claude-3-5-sonnet-2024102212 Dec 2024swebench.comT2 History
92#92qwen3-coder-480b-a35b-instructAlibaba Group55.4%date=2025-08-02 · board=Verified · system=mini-SWE-agent · model_tag=Qwen3-Coder-480B-A35B-Instruct2 Aug 2025swebench.comT2 History
93#93Undisclosed55%date=2024-12-02 · board=Verified · system=Amazon Q Developer Agent · submission=20241202_amazon-q-developer-agent-20241202-dev2 Dec 2024swebench.comT2 History
94#94GLM 4.5Z.ai (Zhipu AI)54.2%date=2025-08-22 · board=Verified · system=mini-SWE-agent · model_tag=GLM-4.522 Aug 2025swebench.comT2 History
95#95claude-35-sonnetAnthropic54.2%date=2024-11-08 · board=Verified · system=devlo · model_tag=claude-3-5-sonnet-202410228 Nov 2024swebench.comT2 History
96#96Devstral 2Mistral AI53.8%date=2025-12-09 · board=Verified · system=mini-SWE-agent · model_tag=devstral-25129 Dec 2025swebench.comT2 History
97#97Frogboss 32B 251053.6%date=2025-11-10 · board=Verified · system=FrogBoss-32B-2510 · model_tag=FrogBoss-32B-251010 Nov 2025swebench.comT2 History
98#98Gemini 2.5 ProGoogle53.6%date=2025-07-26 · board=Verified · system=mini-SWE-agent · model_tag=gemini-2.5-pro26 Jul 2025swebench.comT2 History
99#99Kimi K2 0711Moonshot AI53.4%date=2025-08-04 · board=Verified · system=CodeSweep - SWE-agent · model_tag=kimi-k2-instruct4 Aug 2025swebench.comT2 History
100#100Undisclosed53.2%date=2025-01-20 · board=Verified · system=Bracket.sh · submission=20250120_Bracket20 Jan 2025swebench.comT2 History

Scores are reported as published, with their evaluation configuration (harness, prompting, judge). The bar is relative to the best score on this page. Results with different configs are not directly comparable — see methodology.

The config filter matches a value inside each result's configuration (server-side, `config=` on the API). Chips are the values shared by several rows on the first page; per-model identifiers are not offered.