Undisclosed
Updated 3 h ago · first seen 11 Sept 2026
model_01M29AEFE58DWDQYVBF3BW4R8A
Specification
No structured attributes yet.
Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →
Provenance
Attributed facts
0
Source tiers
—
Freshest observation
—
Conflicts
None
Modalities
Modalities unavailable.
Capabilities
Tool calling
Unavailable
Structured output
Unavailable
Reasoning
Unavailable
Vision
Unavailable
Audio
Unavailable
Fine-tuning available
Unavailable
No capability flags have been observed from a source yet — we do not infer them.
No structured attributes yet.
| Benchmark | Score | Metric | Config | Evaluated | Source |
|---|---|---|---|---|---|
| SWE-bench (full test split) | 41.98% | resolved | date=2025-06-05 · board=Test · system=Atlassian Rovo Dev · submission=20250605_atlassian-rovo-dev | 5 Jun 2025 | swebench.comT2 |
| SWE-bench (full test split) | 13.82% | resolved | date=2024-05-09 · board=Test · system=Amazon Q Developer Agent · submission=20240509_amazon-q-developer-agent-20240430-dev | 9 May 2024 | swebench.comT2 |
| SWE-bench (full test split) | 37.1% | resolved | date=2025-05-22 · board=Test · system=Amazon Q Developer Agent · submission=20250522_amazon-q-developer-agent-20250405-dev | 22 May 2025 | swebench.comT2 |
| SWE-bench (full test split) | 29.99% | resolved | date=2025-01-31 · board=Test · system=Amazon Q Developer Agent · submission=20250131_amazon-q-developer-agent-20241202-dev | 31 Jan 2025 | swebench.comT2 |
| SWE-bench (full test split) | 22.06% | resolved | date=2024-08-20 · board=Test · system=Honeycomb · submission=20240820_honeycomb | 20 Aug 2024 | swebench.comT2 |
| SWE-bench (full test split) | 19.75% | resolved | date=2024-07-21 · board=Test · system=Amazon Q Developer Agent · submission=20240721_amazon-q-developer-agent-20240719-dev | 21 Jul 2024 | swebench.comT2 |
| SWE-bench (full test split) | 19.27% | resolved | date=2024-06-17 · board=Test · system=Factory Code Droid · submission=20240617_factory_code_droid | 17 Jun 2024 | swebench.comT2 |
| SWE-bench Lite | 48.67% | resolved | date=2024-12-08 · board=Lite · system=Gru · submission=20241208_gru | 8 Dec 2024 | swebench.comT2 |
| SWE-bench Lite | 39.33% | resolved | date=2024-09-12 · board=Lite · system=Bytedance MarsCode Agent · submission=20240912_marscode-agent-dev | 12 Sept 2024 | swebench.comT2 |
| SWE-bench Lite | 35% | resolved | date=2024-08-29 · board=Lite · system=Isoform · submission=20240829_Isoform | 29 Aug 2024 | swebench.comT2 |
| SWE-bench Lite | 35.67% | resolved | date=2024-08-11 · board=Lite · system=Gru · submission=20240811_gru | 11 Aug 2024 | swebench.comT2 |
| SWE-bench Lite | 35.67% | resolved | date=2025-01-04 · board=Lite · system=CodeFuse-AAIS · submission=20250104_codefuse-aais | 4 Jan 2025 | swebench.comT2 |
| SWE-bench Lite | 34% | resolved | date=2024-08-06 · board=Lite · system=SuperCoder2.0 · submission=20240806_SuperCoder2.0 | 6 Aug 2024 | swebench.comT2 |
| SWE-bench Lite | 33% | resolved | date=2024-06-22 · board=Lite · system=Alibaba Lingma Agent · submission=20240622_Lingma_Agent | 22 Jun 2024 | swebench.comT2 |
| SWE-bench Lite | 31.33% | resolved | date=2024-06-17 · board=Lite · system=Factory Code Droid · submission=20240617_factory_code_droid | 17 Jun 2024 | swebench.comT2 |
| SWE-bench Lite | 30% | resolved | date=2024-09-08 · board=Lite · system=AIGCode Infant-Coder · submission=20240908_infant_gpt4o | 8 Sept 2024 | swebench.comT2 |
| SWE-bench Lite | 29.67% | resolved | date=2024-07-21 · board=Lite · system=Amazon Q Developer Agent · submission=20240721_amazon-q-developer-agent-20240719-dev | 21 Jul 2024 | swebench.comT2 |
| SWE-bench Lite | 26.67% | resolved | date=2024-06-12 · board=Lite · system=IBM Research Agent-101 · submission=20240612_IBM_Research_Agent101 | 12 Jun 2024 | swebench.comT2 |
| SWE-bench Lite | 20.33% | resolved | date=2024-05-09 · board=Lite · system=Amazon Q Developer Agent · submission=20240509_amazon-q-developer-agent-20240430-dev | 9 May 2024 | swebench.comT2 |
| SWE-bench Lite | 55% | resolved | date=2025-01-14 · board=Lite · system=Isoform · submission=20250114_Isoform | 14 Jan 2025 | swebench.comT2 |
| SWE-bench Lite | 49% | resolved | date=2024-12-20 · board=Lite · system=Blackbox AI Agent · submission=20241220_blackboxai_agent_v1 | 20 Dec 2024 | swebench.comT2 |
| SWE-bench Lite | 48.33% | resolved | date=2024-11-27 · board=Lite · system=Globant Code Fixer Agent · submission=20241127_globant_codefixer_agent | 27 Nov 2024 | swebench.comT2 |
| SWE-bench Lite | 44% | resolved | date=2025-03-10 · board=Lite · system=CodeFuse-CGM · submission=20250310_codefuse-cgm | 10 Mar 2025 | swebench.comT2 |
| SWE-bench Lite | 38.33% | resolved | date=2024-08-20 · board=Lite · system=Honeycomb · submission=20240820_honeycomb | 20 Aug 2024 | swebench.comT2 |
| SWE-bench Multimodal | 29.59% | resolved | date=2025-03-25 · board=Multimodal · system=Globant Code Fixer Agent · submission=20250325_globant_codefixer_agent | 25 Mar 2025 | swebench.comT2 |
| SWE-bench Multimodal | 27.08% | resolved | date=2025-03-11 · board=Multimodal · system=Zencoder · submission=20250311_zencoder | 11 Mar 2025 | swebench.comT2 |
| SWE-bench Verified | 25.8% | resolved | date=2024-10-01 · board=Verified · system=nFactorial · submission=20241001_nfactorial | 1 Oct 2024 | swebench.comT2 |
| SWE-bench Verified | 41.6% | resolved | date=2025-01-12 · board=Verified · system=ugaiforge · submission=20250112_ugaiforge | 12 Jan 2025 | swebench.comT2 |
| SWE-bench Verified | 40.6% | resolved | date=2024-08-20 · board=Verified · system=Honeycomb · submission=20240820_honeycomb | 20 Aug 2024 | swebench.comT2 |
| SWE-bench Verified | 70.6% | resolved | date=2025-05-19 · board=Verified · system=TRAE · submission=20250519_trae | 19 May 2025 | swebench.comT2 |
| SWE-bench Verified | 38.8% | resolved | date=2024-07-21 · board=Verified · system=Amazon Q Developer Agent · submission=20240721_amazon-q-developer-agent-20240719-dev | 21 Jul 2024 | swebench.comT2 |
| SWE-bench Verified | 37% | resolved | date=2024-06-17 · board=Verified · system=Factory Code Droid · submission=20240617_factory_code_droid | 17 Jun 2024 | swebench.comT2 |
| SWE-bench Verified | 70.4% | resolved | date=2025-06-10 · board=Verified · system=Augment Agent v1 · submission=20250610_augment_agent_v1 | 10 Jun 2025 | swebench.comT2 |
| SWE-bench Verified | 25.6% | resolved | date=2024-05-09 · board=Verified · system=Amazon Q Developer Agent · submission=20240509_amazon-q-developer-agent-20240430-dev | 9 May 2024 | swebench.comT2 |
| SWE-bench Verified | 65.8% | resolved | date=2025-04-15 · board=Verified · system=OpenHands · submission=20250415_openhands | 15 Apr 2025 | swebench.comT2 |
| SWE-bench Verified | 65.4% | resolved | date=2025-03-16 · board=Verified · system=Augment Agent v0 · submission=20250316_augment_agent_v0 | 16 Mar 2025 | swebench.comT2 |
| SWE-bench Verified | 65.4% | resolved | date=2025-04-05 · board=Verified · system=Amazon Q Developer Agent · submission=20250405_amazon-q-developer-agent-20250405-dev | 5 Apr 2025 | swebench.comT2 |
| SWE-bench Verified | 62.8% | resolved | date=2025-01-10 · board=Verified · system=Blackbox AI Agent · submission=20250110_blackboxai_agent_v1.1 | 10 Jan 2025 | swebench.comT2 |
| SWE-bench Verified | 58.2% | resolved | date=2024-12-13 · board=Verified · system=devlo · submission=20241213_devlo | 13 Dec 2024 | swebench.comT2 |
| SWE-bench Verified | 57% | resolved | date=2024-12-08 · board=Verified · system=Gru · submission=20241208_gru | 8 Dec 2024 | swebench.comT2 |
| SWE-bench Verified | 56.6% | resolved | date=2025-04-05 · board=Verified · system=SWE-Rizzo · submission=20250405_swe-rizzo_claude37 | 5 Apr 2025 | swebench.comT2 |
| SWE-bench Verified | 55% | resolved | date=2024-12-02 · board=Verified · system=Amazon Q Developer Agent · submission=20241202_amazon-q-developer-agent-20241202-dev | 2 Dec 2024 | swebench.comT2 |
| SWE-bench Verified | 53.2% | resolved | date=2025-01-20 · board=Verified · system=Bracket.sh · submission=20250120_Bracket | 20 Jan 2025 | swebench.comT2 |
| SWE-bench Verified | 50% | resolved | date=2024-10-28 · board=Verified · system=Solver · submission=20241028_solver | 28 Oct 2024 | swebench.comT2 |
| SWE-bench Verified | 50% | resolved | date=2024-11-25 · board=Verified · system=Bytedance MarsCode Agent · submission=20241125_marscode-agent-dev | 25 Nov 2024 | swebench.comT2 |
| SWE-bench Verified | 45.4% | resolved | date=2024-09-24 · board=Verified · system=Solver · submission=20240924_solver | 24 Sept 2024 | swebench.comT2 |
| SWE-bench Verified | 45.2% | resolved | date=2024-08-24 · board=Verified · system=Gru · submission=20240824_gru | 24 Aug 2024 | swebench.comT2 |
| SWE-bench Verified | 32% | resolved | date=2024-11-20 · board=Verified · system=Artemis Agent v1 · submission=20241120_artemis_agent | 20 Nov 2024 | swebench.comT2 |
| SWE-bench Verified | 43.6% | resolved | date=2024-09-20 · board=Verified · system=Solver · submission=20240920_solver | 20 Sept 2024 | swebench.comT2 |
| SWE-bench Verified | 31.6% | resolved | date=2024-10-07 · board=Verified · system=nFactorial · submission=20241007_nfactorial | 7 Oct 2024 | swebench.comT2 |
Scores are reported as published, with their evaluation configuration (harness, prompting, judge). Results with different configs are not directly comparable — see methodology.
Current prices
No current prices recorded
Price history
No hardware estimate available
No lineage recorded
Papers 0
No papers linked yet.
Repositories 0
No repositories linked yet.
As of
Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.
Claim history
No claims recorded yet
Undisclosed scores 27.08% on SWE-bench Multimodal
swebench_leaderboardUndisclosed scores 29.59% on SWE-bench Multimodal
swebench_leaderboard
| Source | Document | Type | Tier | Last observed | Snapshots |
|---|---|---|---|---|---|
| SWE-bench leaderboards | swebench.com/ | leaderboard | T2· Quality secondary | 3 h ago | 1 |
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.