Updated 53 min ago · first seen 11 Sept 2026
model_01M29AEFFEE3FS771C1YM6C16Y
Specification
No structured attributes yet.
Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →
Provenance
Attributed facts
0
Source tiers
—
Freshest observation
—
Conflicts
None
Modalities
Modalities unavailable.
Capabilities
Tool calling
Unavailable
Structured output
Unavailable
Reasoning
Unavailable
Vision
Unavailable
Audio
Unavailable
Fine-tuning available
Unavailable
No capability flags have been observed from a source yet — we do not infer them.
No structured attributes yet.
| Benchmark | Score | Metric | Config | Evaluated | Source |
|---|---|---|---|---|---|
| SWE-bench Lite | 60.33% | resolved | date=2025-06-25 · board=Lite · system=ExpeRepair-v1.0 · model_tag=claude-4-sonnet-20250514 | 25 Jun 2025 | swebench.comT2 |
| SWE-bench Lite | 58.33% | resolved | date=2025-09-06 · board=Lite · system=KGCompass · model_tag=claude-4-sonnet-20250514 | 6 Sept 2025 | swebench.comT2 |
| SWE-bench Lite | 56.67% | resolved | date=2025-05-26 · board=Lite · system=SWE-agent · model_tag=claude-4-sonnet-20250514 | 26 May 2025 | swebench.comT2 |
| SWE-bench Multimodal | 35.59% | resolved | date=2025-06-11 · board=Multimodal · system=Refact.ai Agent · model_tag=claude-4-sonnet | 11 Jun 2025 | swebench.comT2 |
| SWE-bench Verified | 70.8% | resolved | date=2025-06-11 · board=Verified · system=Moatless Tools · model_tag=claude-4-sonnet-20250514 | 11 Jun 2025 | swebench.comT2 |
| SWE-bench Verified | 70.4% | resolved | date=2025-05-24 · board=Verified · system=OpenHands · model_tag=claude-4-sonnet-20250514 | 24 May 2025 | swebench.comT2 |
| SWE-bench Verified | 76.8% | resolved | date=2025-08-04 · board=Verified · system=EPAM AI/Run Developer Agent · model_tag=claude-sonnet-4-20250514 | 4 Aug 2025 | swebench.comT2 |
| SWE-bench Verified | 64.93% | resolved | date=2025-07-26 · board=Verified · system=mini-SWE-agent · model_tag=claude-4-sonnet-20250514 | 26 Jul 2025 | swebench.comT2 |
| SWE-bench Verified | 66.6% | resolved | date=2025-05-22 · board=Verified · system=SWE-agent · model_tag=claude-4-sonnet-20250514 | 22 May 2025 | swebench.comT2 |
| SWE-bench Verified | 74.6% | resolved | date=2025-07-20 · board=Verified · system=Lingxi-v1.5 · model_tag=claude-4-sonnet-20250514 | 20 Jul 2025 | swebench.comT2 |
| SWE-bench Verified | 72.4% | resolved | date=2025-05-22 · board=Verified · system=Tools · model_tag=claude-4-sonnet-20250514 | 22 May 2025 | swebench.comT2 |
| SWE-bench Verified | 71.2% | resolved | date=2025-07-10 · board=Verified · system=Bloop · model_tag=claude-4-sonnet-20250514 | 10 Jul 2025 | swebench.comT2 |
Scores are reported as published, with their evaluation configuration (harness, prompting, judge). Results with different configs are not directly comparable — see methodology.
Current prices
No current prices recorded
Price history
No hardware estimate available
No lineage recorded
Papers 0
No papers linked yet.
Repositories 0
No repositories linked yet.
As of
Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.
Claim history
No claims recorded yet
Claude 4 Sonnet scores 35.59% on SWE-bench Multimodal
swebench_leaderboardClaude 4 Sonnet scores 56.67% on SWE-bench Lite
swebench_leaderboardClaude 4 Sonnet scores 58.33% on SWE-bench Lite
swebench_leaderboardClaude 4 Sonnet scores 60.33% on SWE-bench Lite
swebench_leaderboardClaude 4 Sonnet scores 64.93% on SWE-bench Verified
swebench_leaderboardClaude 4 Sonnet scores 66.6% on SWE-bench Verified
swebench_leaderboardClaude 4 Sonnet scores 70.4% on SWE-bench Verified
swebench_leaderboardClaude 4 Sonnet scores 70.8% on SWE-bench Verified
swebench_leaderboardClaude 4 Sonnet scores 71.2% on SWE-bench Verified
swebench_leaderboardClaude 4 Sonnet scores 72.4% on SWE-bench Verified
swebench_leaderboardClaude 4 Sonnet scores 74.6% on SWE-bench Verified
swebench_leaderboardClaude 4 Sonnet scores 76.8% on SWE-bench Verified
swebench_leaderboard
| Source | Document | Type | Tier | Last observed | Snapshots |
|---|---|---|---|---|---|
| SWE-bench leaderboards | swebench.com/ | leaderboard | T2· Quality secondary | 53 min ago | 1 |
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.