Skip to content
AI Atlas
BenchmarkActivecategory · coding

Aider polyglot

aider.chat/docs/leaderboards

225 Exercism exercises in 6 languages, edit-format aware

quality57

Updated 6 h ago · first seen 11 Sept 2026

bench_01M293SPEMVE6W55699099NES3

Metric
pass rate (2 attempts) · %
Direction
Higher is better
Results
138 · 106 filtered
Leader
QwQ-32B + Qwen 2.5 Coder Instruct 100%

Score history · gpt-5 (high) 2 rows

Not enough history to chart — 2 observations, all dated 23 Aug 2025. Rows under different configurations count separately; the list below shows each one.

  • 91.6%date=2025-08-23 · command=aider --model openai/gpt-5 · dirname=2025-08-23-15-47-21--gpt-5-high · versions=0.86.2.dev23 Aug 2025
  • 88%date=2025-08-23 · command=aider --model openai/gpt-5 · dirname=2025-08-23-15-47-21--gpt-5-high · versions=0.86.2.dev23 Aug 2025

Back to the full leaderboard

Leaderboard 106 current results · config contains “diff”

Select models with +, then open Compare.

Leaderboard
#ModelScoreConfigEvaluatedSourceActions
1#1gemini-2.5-pro-preview-06-05 (default think)100%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 · dirname=2025-06-06-18-38-56--gemini0605-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
2#2o3 (high) + gpt-4.1100%date=2025-06-27 · command=aider --model o3 · dirname=2025-06-27-23-53-57--o3-mini-high-diff-arch · versions=0.85.1.dev27 Jun 2025aider.chatT2 History
3#3gemini-2.5-pro-preview-06-05 (32k think)99.6%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 --thinking-tokens 32k · dirname=2025-06-06-16-36-21--gemini0605-32k-think-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
4#4Grok 3 Beta99.6%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-beta · dirname=2025-04-10-04-21-31--grok3-diff-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
5#5claude-3-5-sonnet-20241022Anthropic99.6%date=2025-01-17 · command=aider --model claude-3-5-sonnet-20241022 · dirname=2025-01-17-19-44-33--sonnet-baseline-jan-17 · versions=0.71.2.dev17 Jan 2025aider.chatT2 History
6#6DeepSeek V3 0324DeepSeek99.6%date=2025-03-24 · command=aider --model deepseek/deepseek-chat · dirname=2025-03-24-15-41-33--deepseek-v3-0324-polyglot-diff · versions=0.78.1.dev24 Mar 2025aider.chatT2 History
7#7DeepSeek Chat V3 (prev)98.7%date=2024-12-25 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-25-13-31-51--deepseekv3preview-diff2 · versions=0.69.2.dev25 Dec 2024aider.chatT2 History
8#8claude-opus-4-20250514 (no think)98.7%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-19-57-20--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
9#9gpt-4.1OpenAI98.2%date=2025-04-14 · command=aider --model gpt-4.1 · dirname=2025-04-14-21-05-54--gpt41-diff-exuser · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
10#10Quasar Alpha98.2%date=2025-04-04 · command=aider --model openrouter/openrouter/quasar-alpha · dirname=2025-04-04-02-57-25--qalpha-diff-exsys · versions=0.80.5.dev4 Apr 2025aider.chatT2 History
11#11DeepSeek-V3.2-Exp (Chat)98.2%date=2025-10-03 · command=aider --model deepseek/deepseek-chat · dirname=2025-10-03-09-21-36--deepseek-v3.2-chat · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
12#12claude-sonnet-4-20250514 (no thinking)98.2%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-21-17-54--sonnet4-diff-exuser · versions=0.83.3.dev24 May 2025aider.chatT2 History
13#13o3-pro (high)97.8%date=2025-06-28 · command=aider --model o3-pro · dirname=2025-06-28-00-38-18--o3-pro-high · versions=0.85.1.dev28 Jun 2025aider.chatT2 History
14#14claude-3-7-sonnet-20250219 (32k thinking tokens)97.8%date=2025-02-24 · command=aider --model anthropic/claude-3-7-sonnet-20250219 --thinking-tokens 32k · dirname=2025-02-24-21-47-23--sonnet37-diff-think-32k-64k · versions=0.75.1.dev24 Feb 2025aider.chatT2 History
15#15Optimus Alpha97.3%date=2025-04-10 · command=aider --model openrouter/openrouter/optimus-alpha · dirname=2025-04-10-19-02-44--oalpha-diff-exsys · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
16#16DeepSeek-V3.2-Exp (Reasoner)97.3%date=2025-10-03 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-10-03-09-45-34--deepseek-v3.2-reasoner · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
17#17GPT-4.5 PreviewOpenAI97.3%date=2025-02-27 · command=aider --model openai/gpt-4.5-preview · dirname=2025-02-27-20-26-15--gpt45-diff3 · versions=0.75.2.dev27 Feb 2025aider.chatT2 History
18#18Gemini 2.5 Pro Preview 05-06Google97.3%date=2025-05-07 · command=aider --model gemini/gemini-2.5-pro-preview-05-06 · dirname=2025-05-07-19-32-40--gemini0506-diff-fenced-completion_cost · versions=0.82.4.dev7 May 2025aider.chatT2 History
19#19claude-sonnet-4-20250514 (32k thinking)97.3%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-22-10-36--sonnet4-diff-exuser-think32k · versions=0.83.3.dev24 May 2025aider.chatT2 History
20#20claude-opus-4-20250514 (32k thinking)97.3%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-20-40-51--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
21#21grok-4 (high)97.3%date=2025-07-11 · command=aider --model openrouter/x-ai/grok-4 · dirname=2025-07-11-19-37-40--xai-or-grok4-high · versions=0.85.2.dev11 Jul 2025aider.chatT2 History
22#22R1DeepSeek96.9%date=2025-01-20 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-01-20-19-11-38--ds-turns-upd-cur-msgs-fix-with-summarizer · versions=0.71.2.dev20 Jan 2025aider.chatT2 History
23#23gemini-2.5-flash-preview-05-20 (24k think)95.6%date=2025-05-25 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-25-22-58-44--flash25-05-20-24k-think · versions=0.83.3.dev25 May 2025aider.chatT2 History
24#24GPT-4o (2024-11-20)OpenAI95.1%date=2024-12-30 · command=aider --model gpt-4o-2024-11-20 · dirname=2024-12-30-20-57-12--gpt-4o-2024-11-20-ex-as-sys · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
25#25o3-mini (medium)95.1%date=2025-01-31 · command=aider --model o3-mini · dirname=2025-01-31-20-27-46--o3-mini-diff2 · versions=0.72.4.dev31 Jan 2025aider.chatT2 History
26#26o3 (high)94.7%date=2025-06-25 · command=aider --model o3 --reasoning-effort high · dirname=2025-06-25-21-04-24--o3-price-reduction-high · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
27#27R1 0528DeepSeek94.6%date=2025-06-06 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-06-06-16-47-07--r1-diff · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
28#28GPT-4o (2024-08-06)OpenAI94.2%date=2024-12-30 · command=aider --model gpt-4o-2024-08-06 · dirname=2024-12-30-20-44-54--gpt4o-ex-as-sys-clean-prompt · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
29#29gpt-4.1-nanoOpenAI94.2%date=2025-04-14 · command=aider --model gpt-4.1-nano · dirname=2025-04-14-22-46-01--gpt41nano-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
30#30gemini-2.5-flash-preview-05-20 (no think)93.8%date=2025-05-26 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-26-15-56-31--flash25-05-20-24k-think · versions=0.83.3.dev26 May 2025aider.chatT2 History
31#31o3OpenAI93.8%date=2025-06-25 · command=aider --model o3 · dirname=2025-06-25-20-30-16--o3-price-reduction · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
32#32o3 Mini HighOpenAI93.3%date=2025-01-31 · command=aider --model o3-mini --reasoning-effort high · dirname=2025-01-31-20-42-47--o3-mini-diff-high · versions=0.72.4.dev31 Jan 2025aider.chatT2 History
33#33chatgpt-4o-latest (2025-02-15)93.3%date=2025-02-15 · command=aider --model chatgpt-4o-latest · dirname=2025-02-15-19-51-22--chatgpt4o-feb15-diff · versions=0.74.3.dev15 Feb 2025aider.chatT2 History
34#34claude-3-7-sonnet-20250219 (no thinking)93.3%date=2025-02-24 · command=aider --model sonnet · dirname=2025-02-24-19-54-07--sonnet37-diff · versions=0.74.4.dev24 Feb 2025aider.chatT2 History
35#35DeepSeek Chat V2.592.9%date=2024-12-21 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-21-20-56-21--polyglot-deepseek-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
36#36Qwen3 235B A22B diff, no think, Alibaba API92.9%date=2025-05-09 · command=aider --model openai/qwen3-235b-a22b · dirname=2025-05-09-17-02-02--qwen3-235b-a22b.unthink_16k_diff · versions=0.82.4.dev9 May 2025aider.chatT2 History
37#37Kimi K2 0711Moonshot AI92.9%date=2025-07-17 · command=aider --model openrouter/moonshotai/kimi-k2 · dirname=2025-07-17-17-41-54--kimi-k2-diff-or-pricing · versions=0.85.3.dev17 Jul 2025aider.chatT2 History
38#38gpt-4.1-miniOpenAI92.4%date=2025-04-14 · command=aider --model gpt-4.1-mini · dirname=2025-04-14-21-27-53--gpt41mini-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
39#39Gemini 2.5 Pro Preview 03-2592.4%date=2025-04-12 · command=aider --model gemini/gemini-2.5-pro-preview-03-25 · dirname=2025-04-12-04-55-50--gemini-25-pro-diff-fenced · versions=0.81.3.dev12 Apr 2025aider.chatT2 History
40#40gpt-5 (high)91.6%date=2025-08-23 · command=aider --model openai/gpt-5 · dirname=2025-08-23-15-47-21--gpt-5-high · versions=0.86.2.dev23 Aug 2025aider.chatT2 History
41#41o1-2024-12-17 (high)91.5%date=2024-12-21 · command=aider --model openrouter/openai/o1 · dirname=2024-12-21-19-23-03--polyglot-o1-hard-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
42#42Claude Haiku 3.5Anthropic91.1%date=2024-12-21 · command=aider --model claude-3-5-haiku-20241022 · dirname=2024-12-21-21-46-27--polyglot-haiku-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
43#43o4 Mini HighOpenAI90.7%date=2025-04-16 · command=aider --model o4-mini · dirname=2025-04-16-22-01-58--o4-mini-high-diff-exsys · versions=0.82.1.dev16 Apr 2025aider.chatT2 History
44#44qwen-max-2025-01-2590.2%date=2025-01-28 · command=OPENAI_API_BASE=https://dashscope-intl.aliyuncs.com/compatible-mode/v1 aider --model openai/qwen-max-2025-01-25 · dirname=2025-01-28-16-00-03--qwen-max-2025-01-25-polyglot-diff · versions=0.72.4.dev28 Jan 2025aider.chatT2 History
45#45gpt-5 (medium)OpenAI88.4%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-13-23-27--gpt-5-medium · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
46#46gpt-5 (high)88%date=2025-08-23 · command=aider --model openai/gpt-5 · dirname=2025-08-23-15-47-21--gpt-5-high · versions=0.86.2.dev23 Aug 2025aider.chatT2 History
47#47gpt-5 (low)OpenAI86.7%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-14-16-37--gpt-5-low · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
48#48gpt-5 (medium)OpenAI86.7%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-13-23-27--gpt-5-medium · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
49#49gemini-2.5-flash-preview-04-17 (default)85.3%date=2025-04-20 · command=aider --model gemini/gemini-2.5-flash-preview-04-17 · dirname=2025-04-20-19-54-31--flash25-diff-no-think · versions=0.82.3.dev20 Apr 2025aider.chatT2 History
50#50o3-pro (high)84.9%date=2025-06-28 · command=aider --model o3-pro · dirname=2025-06-28-00-38-18--o3-pro-high · versions=0.85.1.dev28 Jun 2025aider.chatT2 History
51#51Qwen3 32BQwen83.6%date=2025-05-08 · command=aider --model openrouter/qwen/qwen3-32b · dirname=2025-05-08-03-20-24--qwen3-32b-default · versions=0.82.4.dev8 May 2025aider.chatT2 History
52#52gemini-2.5-pro-preview-06-05 (32k think)83.1%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 --thinking-tokens 32k · dirname=2025-06-06-16-36-21--gemini0605-32k-think-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
53#53o3 (high)81.3%date=2025-06-25 · command=aider --model o3 --reasoning-effort high · dirname=2025-06-25-21-04-24--o3-price-reduction-high · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
54#54gpt-5 (low)OpenAI81.3%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-14-16-37--gpt-5-low · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
55#55grok-4 (high)79.6%date=2025-07-11 · command=aider --model openrouter/x-ai/grok-4 · dirname=2025-07-11-19-37-40--xai-or-grok4-high · versions=0.85.2.dev11 Jul 2025aider.chatT2 History
56#56gpt-oss-120b (high)79.1%date=2025-08-06 · command=aider --model openrouter/openai/gpt-oss-120b --reasoning-effort high · dirname=2025-08-06-04-54-48--gpt-oss-120b-high-polyglot · versions=0.85.3.dev6 Aug 2025aider.chatT2 History
57#57gemini-2.5-pro-preview-06-05 (default think)79.1%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 · dirname=2025-06-06-18-38-56--gemini0605-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
58#58o3 (high) + gpt-4.178.2%date=2025-06-27 · command=aider --model o3 · dirname=2025-06-27-23-53-57--o3-mini-high-diff-arch · versions=0.85.1.dev27 Jun 2025aider.chatT2 History
59#59gemini-2.0-flash-thinking-exp-01-21Google77.8%date=2025-01-21 · command=aider --model gemini/gemini-2.0-flash-thinking-exp-01-21 · dirname=2025-01-21-22-51-49--gemini-2.0-flash-thinking-exp-01-21-polyglot-diff · versions=0.72.2.dev21 Jan 2025aider.chatT2 History
60#60Gemini 2.5 Pro Preview 05-06Google76.9%date=2025-05-07 · command=aider --model gemini/gemini-2.5-pro-preview-05-06 · dirname=2025-05-07-19-32-40--gemini0506-diff-fenced-completion_cost · versions=0.82.4.dev7 May 2025aider.chatT2 History
61#61o3OpenAI76.9%date=2025-06-25 · command=aider --model o3 · dirname=2025-06-25-20-30-16--o3-price-reduction · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
62#62DeepSeek-V3.2-Exp (Reasoner)74.2%date=2025-10-03 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-10-03-09-45-34--deepseek-v3.2-reasoner · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
63#63Gemini 2.5 Pro Preview 03-2572.9%date=2025-04-12 · command=aider --model gemini/gemini-2.5-pro-preview-03-25 · dirname=2025-04-12-04-55-50--gemini-25-pro-diff-fenced · versions=0.81.3.dev12 Apr 2025aider.chatT2 History
64#64o4 Mini HighOpenAI72%date=2025-04-16 · command=aider --model o4-mini · dirname=2025-04-16-22-01-58--o4-mini-high-diff-exsys · versions=0.82.1.dev16 Apr 2025aider.chatT2 History
65#65claude-opus-4-20250514 (32k thinking)72%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-20-40-51--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
66#66Qwen2.5 Coder 32B InstructQwen71.6%date=2024-12-22 · command=aider --model openai/Qwen/Qwen2.5-Coder-32B-Instruct # via hyperbolic · dirname=2024-12-22-13-22-32--polyglot-qwen-diff · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
67#67R1 0528DeepSeek71.4%date=2025-06-06 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-06-06-16-47-07--r1-diff · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
68#68claude-opus-4-20250514 (no think)70.7%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-19-57-20--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
69#69DeepSeek-V3.2-Exp (Chat)70.2%date=2025-10-03 · command=aider --model deepseek/deepseek-chat · dirname=2025-10-03-09-21-36--deepseek-v3.2-chat · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
70#70QwQ-32BAlibaba Group67.6%date=2025-03-06 · command=aider --model fireworks_ai/accounts/fireworks/models/qwq-32b · dirname=2025-03-06-17-40-24--qwq32b-diff-temp-topp-ex-sys-remind-user-for-real · versions=0.75.3.dev6 Mar 2025aider.chatT2 History
71#71claude-3-7-sonnet-20250219 (32k thinking tokens)64.9%date=2025-02-24 · command=aider --model anthropic/claude-3-7-sonnet-20250219 --thinking-tokens 32k · dirname=2025-02-24-21-47-23--sonnet37-diff-think-32k-64k · versions=0.75.1.dev24 Feb 2025aider.chatT2 History
72#72chatgpt-4o-latest (2025-03-29)64.4%date=2025-03-29 · command=aider --model chatgpt-4o-latest · dirname=2025-03-29-05-24-55--chatgpt4o-mar28-diff · versions=0.79.3.dev29 Mar 2025aider.chatT2 History
73#73o1-2024-12-17 (high)61.7%date=2024-12-21 · command=aider --model openrouter/openai/o1 · dirname=2024-12-21-19-23-03--polyglot-o1-hard-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
74#74claude-sonnet-4-20250514 (32k thinking)61.3%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-22-10-36--sonnet4-diff-exuser-think32k · versions=0.83.3.dev24 May 2025aider.chatT2 History
75#75o3 Mini HighOpenAI60.4%date=2025-01-31 · command=aider --model o3-mini --reasoning-effort high · dirname=2025-01-31-20-42-47--o3-mini-diff-high · versions=0.72.4.dev31 Jan 2025aider.chatT2 History
76#76claude-3-7-sonnet-20250219 (no thinking)60.4%date=2025-02-24 · command=aider --model sonnet · dirname=2025-02-24-19-54-07--sonnet37-diff · versions=0.74.4.dev24 Feb 2025aider.chatT2 History
77#77Qwen3 235B A22B diff, no think, Alibaba API59.6%date=2025-05-09 · command=aider --model openai/qwen3-235b-a22b · dirname=2025-05-09-17-02-02--qwen3-235b-a22b.unthink_16k_diff · versions=0.82.4.dev9 May 2025aider.chatT2 History
78#78Kimi K2 0711Moonshot AI59.1%date=2025-07-17 · command=aider --model openrouter/moonshotai/kimi-k2 · dirname=2025-07-17-17-41-54--kimi-k2-diff-or-pricing · versions=0.85.3.dev17 Jul 2025aider.chatT2 History
79#79R1DeepSeek56.9%date=2025-01-20 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-01-20-19-11-38--ds-turns-upd-cur-msgs-fix-with-summarizer · versions=0.71.2.dev20 Jan 2025aider.chatT2 History
80#80claude-sonnet-4-20250514 (no thinking)56.4%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-21-17-54--sonnet4-diff-exuser · versions=0.83.3.dev24 May 2025aider.chatT2 History
81#81gemini-2.5-flash-preview-05-20 (24k think)55.1%date=2025-05-25 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-25-22-58-44--flash25-05-20-24k-think · versions=0.83.3.dev25 May 2025aider.chatT2 History
82#82DeepSeek V3 0324DeepSeek55.1%date=2025-03-24 · command=aider --model deepseek/deepseek-chat · dirname=2025-03-24-15-41-33--deepseek-v3-0324-polyglot-diff · versions=0.78.1.dev24 Mar 2025aider.chatT2 History
83#83Quasar Alpha54.7%date=2025-04-04 · command=aider --model openrouter/openrouter/quasar-alpha · dirname=2025-04-04-02-57-25--qalpha-diff-exsys · versions=0.80.5.dev4 Apr 2025aider.chatT2 History
84#84o3-mini (medium)53.8%date=2025-01-31 · command=aider --model o3-mini · dirname=2025-01-31-20-27-46--o3-mini-diff2 · versions=0.72.4.dev31 Jan 2025aider.chatT2 History
85#85Grok 3 Beta53.3%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-beta · dirname=2025-04-10-04-21-31--grok3-diff-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
86#86Optimus Alpha52.9%date=2025-04-10 · command=aider --model openrouter/openrouter/optimus-alpha · dirname=2025-04-10-19-02-44--oalpha-diff-exsys · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
87#87gpt-4.1OpenAI52.4%date=2025-04-14 · command=aider --model gpt-4.1 · dirname=2025-04-14-21-05-54--gpt41-diff-exuser · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
88#88claude-3-5-sonnet-20241022Anthropic51.6%date=2025-01-17 · command=aider --model claude-3-5-sonnet-20241022 · dirname=2025-01-17-19-44-33--sonnet-baseline-jan-17 · versions=0.71.2.dev17 Jan 2025aider.chatT2 History
89#89DeepSeek Chat V3 (prev)48.4%date=2024-12-25 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-25-13-31-51--deepseekv3preview-diff2 · versions=0.69.2.dev25 Dec 2024aider.chatT2 History
90#90gemini-2.5-flash-preview-04-17 (default)47.1%date=2025-04-20 · command=aider --model gemini/gemini-2.5-flash-preview-04-17 · dirname=2025-04-20-19-54-31--flash25-diff-no-think · versions=0.82.3.dev20 Apr 2025aider.chatT2 History
91#91chatgpt-4o-latest (2025-03-29)45.3%date=2025-03-29 · command=aider --model chatgpt-4o-latest · dirname=2025-03-29-05-24-55--chatgpt4o-mar28-diff · versions=0.79.3.dev29 Mar 2025aider.chatT2 History
92#92GPT-4.5 PreviewOpenAI44.9%date=2025-02-27 · command=aider --model openai/gpt-4.5-preview · dirname=2025-02-27-20-26-15--gpt45-diff3 · versions=0.75.2.dev27 Feb 2025aider.chatT2 History
93#93gemini-2.5-flash-preview-05-20 (no think)44%date=2025-05-26 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-26-15-56-31--flash25-05-20-24k-think · versions=0.83.3.dev26 May 2025aider.chatT2 History
94#94gpt-oss-120b (high)41.8%date=2025-08-06 · command=aider --model openrouter/openai/gpt-oss-120b --reasoning-effort high · dirname=2025-08-06-04-54-48--gpt-oss-120b-high-polyglot · versions=0.85.3.dev6 Aug 2025aider.chatT2 History
95#95Qwen3 32BQwen40%date=2025-05-08 · command=aider --model openrouter/qwen/qwen3-32b · dirname=2025-05-08-03-20-24--qwen3-32b-default · versions=0.82.4.dev8 May 2025aider.chatT2 History
96#96gpt-4.1-miniOpenAI32.4%date=2025-04-14 · command=aider --model gpt-4.1-mini · dirname=2025-04-14-21-27-53--gpt41mini-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
97#97Claude Haiku 3.5Anthropic28%date=2024-12-21 · command=aider --model claude-3-5-haiku-20241022 · dirname=2024-12-21-21-46-27--polyglot-haiku-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
98#98chatgpt-4o-latest (2025-02-15)27.1%date=2025-02-15 · command=aider --model chatgpt-4o-latest · dirname=2025-02-15-19-51-22--chatgpt4o-feb15-diff · versions=0.74.3.dev15 Feb 2025aider.chatT2 History
99#99GPT-4o (2024-08-06)OpenAI23.1%date=2024-12-30 · command=aider --model gpt-4o-2024-08-06 · dirname=2024-12-30-20-44-54--gpt4o-ex-as-sys-clean-prompt · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
100#100qwen-max-2025-01-2521.8%date=2025-01-28 · command=OPENAI_API_BASE=https://dashscope-intl.aliyuncs.com/compatible-mode/v1 aider --model openai/qwen-max-2025-01-25 · dirname=2025-01-28-16-00-03--qwen-max-2025-01-25-polyglot-diff · versions=0.72.4.dev28 Jan 2025aider.chatT2 History

Scores are reported as published, with their evaluation configuration (harness, prompting, judge). The bar is relative to the best score on this page. Results with different configs are not directly comparable — see methodology.

The config filter matches a value inside each result's configuration (server-side, `config=` on the API). Chips are the values shared by several rows on the first page; per-model identifiers are not offered.