Skip to content
AI Atlas
BenchmarkActivecategory · coding

Aider polyglot

aider.chat/docs/leaderboards

225 Exercism exercises in 6 languages, edit-format aware

quality57

Updated 3 h ago · first seen 11 Sept 2026

bench_01M293SPEMVE6W55699099NES3

Metric
pass rate (2 attempts) · %
Direction
Higher is better
Results
138
Leader
QwQ-32B + Qwen 2.5 Coder Instruct 100%

Score history · gpt-5 (low) 2 rows

Not enough history to chart — 2 observations, all dated 25 Aug 2025. Rows under different configurations count separately; the list below shows each one.

  • 86.7%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-14-16-37--gpt-5-low · versions=0.86.2.dev25 Aug 2025
  • 81.3%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-14-16-37--gpt-5-low · versions=0.86.2.dev25 Aug 2025

Back to the full leaderboard

Leaderboard 138 current results

Select models with +, then open Compare.

Leaderboard
#ModelScoreConfigEvaluatedSourceActions
1#1QwQ-32B + Qwen 2.5 Coder Instruct100%date=2025-03-07 · command=aider --model fireworks_ai/accounts/fireworks/models/qwq-32b --architect · dirname=2025-03-07-15-11-27--qwq32b-arch-temp-topp-again · versions=0.75.3.dev7 Mar 2025aider.chatT2 History
2#2Gemma 3 27BGoogle100%date=2025-03-15 · command=aider --model openrouter/google/gemma-3-27b-it · dirname=2025-03-15-01-21-24--gemma3-27b-or · versions=0.77.1.dev15 Mar 2025aider.chatT2 History
3#3GPT-4o-mini (2024-07-18)OpenAI100%date=2024-12-21 · command=aider --model gpt-4o-mini-2024-07-18 · dirname=2024-12-21-18-41-18--polyglot-gpt-4o-mini · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
4#4Grok 3 Mini Beta (low)100%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-mini-beta · dirname=2025-04-10-18-47-24--grok3-mini-whole-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
5#5DeepSeek R1 + claude-3-5-sonnet-20241022100%date=2025-01-23 · command=aider --architect --model r1 --editor-model sonnet · dirname=2025-01-23-19-14-48--r1-architect-sonnet · versions=0.72.3.dev23 Jan 2025aider.chatT2 History
6#6Gemini 2.0 Pro exp-02-05100%date=2025-02-25 · command=aider --model gemini/gemini-2.0-pro-exp-02-05 · dirname=2025-02-25-20-23-07--gemini-pro · versions=0.75.2.dev25 Feb 2025aider.chatT2 History
7#7o3 (high) + gpt-4.1100%date=2025-06-27 · command=aider --model o3 · dirname=2025-06-27-23-53-57--o3-mini-high-diff-arch · versions=0.85.1.dev27 Jun 2025aider.chatT2 History
8#8Codestral 25.01Mistral AI100%date=2025-01-13 · command=aider --model mistral/codestral-latest · dirname=2025-01-13-18-17-25--codestral-whole2 · versions=0.71.2.dev13 Jan 2025aider.chatT2 History
9#9gemini-2.5-pro-preview-06-05 (default think)100%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 · dirname=2025-06-06-18-38-56--gemini0605-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
10#10gemini-2.0-flash-expGoogle100%date=2024-12-22 · command=aider --model gemini/gemini-2.0-flash-exp · dirname=2024-12-22-20-08-13--gemini-2.0-flash-exp-polyglot-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
11#11Qwen2.5 Coder 32B InstructQwen99.6%date=2024-12-26 · command=aider --model openai/Qwen2.5-Coder-32B-Instruct · dirname=2024-12-26-00-55-20--Qwen2.5-Coder-32B-Instruct · versions=0.69.2.dev26 Dec 2024aider.chatT2 History
12#12claude-3-5-sonnet-20241022Anthropic99.6%date=2025-01-17 · command=aider --model claude-3-5-sonnet-20241022 · dirname=2025-01-17-19-44-33--sonnet-baseline-jan-17 · versions=0.71.2.dev17 Jan 2025aider.chatT2 History
13#13gemini-2.5-pro-preview-06-05 (32k think)99.6%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 --thinking-tokens 32k · dirname=2025-06-06-16-36-21--gemini0605-32k-think-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
14#14Grok 3 Mini Beta (high)99.6%date=2025-04-10 · command=aider --model xai/grok-3-mini-beta --reasoning-effort high · dirname=2025-04-10-23-59-02--xai-grok3-mini-whole-high · versions=0.81.3.dev10 Apr 2025aider.chatT2 History
15#15Grok 3 Beta99.6%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-beta · dirname=2025-04-10-04-21-31--grok3-diff-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
16#16DeepSeek V3 0324DeepSeek99.6%date=2025-03-24 · command=aider --model deepseek/deepseek-chat · dirname=2025-03-24-15-41-33--deepseek-v3-0324-polyglot-diff · versions=0.78.1.dev24 Mar 2025aider.chatT2 History
17#17command-a-03-2025-quality99.6%date=2025-03-14 · command=OPENAI_API_BASE=https://api.cohere.ai/compatibility/v1 aider --model openai/command-a-03-2025-quality · dirname=2025-03-14-23-40-00--cmda-quality-whole2 · versions=0.77.1.dev14 Mar 2025aider.chatT2 History
18#18Llama 4 MaverickMeta AI99.1%date=2025-04-06 · command=aider --model nvidia_nim/meta/llama-4-maverick-17b-128e-instruct · dirname=2025-04-06-08-39-52--llama-4-maverick-17b-128e-instruct-polyglot-whole · versions=0.81.2.dev6 Apr 2025aider.chatT2 History
19#19DeepSeek Chat V3 (prev)98.7%date=2024-12-25 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-25-13-31-51--deepseekv3preview-diff2 · versions=0.69.2.dev25 Dec 2024aider.chatT2 History
20#20claude-opus-4-20250514 (no think)98.7%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-19-57-20--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
21#21gemini-exp-120698.2%date=2024-12-22 · command=aider --model gemini/gemini-exp-1206 · dirname=2024-12-22-18-43-25--gemini-exp-1206-polyglot-whole-2 · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
22#22DeepSeek-V3.2-Exp (Chat)98.2%date=2025-10-03 · command=aider --model deepseek/deepseek-chat · dirname=2025-10-03-09-21-36--deepseek-v3.2-chat · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
23#23gpt-4.1OpenAI98.2%date=2025-04-14 · command=aider --model gpt-4.1 · dirname=2025-04-14-21-05-54--gpt41-diff-exuser · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
24#24claude-sonnet-4-20250514 (no thinking)98.2%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-21-17-54--sonnet4-diff-exuser · versions=0.83.3.dev24 May 2025aider.chatT2 History
25#25Quasar Alpha98.2%date=2025-04-04 · command=aider --model openrouter/openrouter/quasar-alpha · dirname=2025-04-04-02-57-25--qalpha-diff-exsys · versions=0.80.5.dev4 Apr 2025aider.chatT2 History
26#26claude-3-7-sonnet-20250219 (32k thinking tokens)97.8%date=2025-02-24 · command=aider --model anthropic/claude-3-7-sonnet-20250219 --thinking-tokens 32k · dirname=2025-02-24-21-47-23--sonnet37-diff-think-32k-64k · versions=0.75.1.dev24 Feb 2025aider.chatT2 History
27#27o3-pro (high)97.8%date=2025-06-28 · command=aider --model o3-pro · dirname=2025-06-28-00-38-18--o3-pro-high · versions=0.85.1.dev28 Jun 2025aider.chatT2 History
28#28claude-opus-4-20250514 (32k thinking)97.3%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-20-40-51--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
29#29GPT-4.5 PreviewOpenAI97.3%date=2025-02-27 · command=aider --model openai/gpt-4.5-preview · dirname=2025-02-27-20-26-15--gpt45-diff3 · versions=0.75.2.dev27 Feb 2025aider.chatT2 History
30#30Optimus Alpha97.3%date=2025-04-10 · command=aider --model openrouter/openrouter/optimus-alpha · dirname=2025-04-10-19-02-44--oalpha-diff-exsys · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
31#31Gemini 2.5 Pro Preview 05-06Google97.3%date=2025-05-07 · command=aider --model gemini/gemini-2.5-pro-preview-05-06 · dirname=2025-05-07-19-32-40--gemini0506-diff-fenced-completion_cost · versions=0.82.4.dev7 May 2025aider.chatT2 History
32#32claude-sonnet-4-20250514 (32k thinking)97.3%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-22-10-36--sonnet4-diff-exuser-think32k · versions=0.83.3.dev24 May 2025aider.chatT2 History
33#33grok-4 (high)97.3%date=2025-07-11 · command=aider --model openrouter/x-ai/grok-4 · dirname=2025-07-11-19-37-40--xai-or-grok4-high · versions=0.85.2.dev11 Jul 2025aider.chatT2 History
34#34DeepSeek-V3.2-Exp (Reasoner)97.3%date=2025-10-03 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-10-03-09-45-34--deepseek-v3.2-reasoner · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
35#35o1-mini-2024-09-1296.9%date=2024-12-22 · command=aider --model o1-mini · dirname=2024-12-22-21-26-35--polyglot-o1mini-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
36#36R1DeepSeek96.9%date=2025-01-20 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-01-20-19-11-38--ds-turns-upd-cur-msgs-fix-with-summarizer · versions=0.71.2.dev20 Jan 2025aider.chatT2 History
37#37gemini-2.5-flash-preview-05-20 (24k think)95.6%date=2025-05-25 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-25-22-58-44--flash25-05-20-24k-think · versions=0.83.3.dev25 May 2025aider.chatT2 History
38#38o3-mini (medium)95.1%date=2025-01-31 · command=aider --model o3-mini · dirname=2025-01-31-20-27-46--o3-mini-diff2 · versions=0.72.4.dev31 Jan 2025aider.chatT2 History
39#39openhands-lm-32b-v0.195.1%date=2025-04-19 · command=aider --model openrouter/all-hands/openhands-lm-32b-v0.1 · dirname=2025-04-19-14-43-04--o4-mini-patch · versions=0.82.2.dev19 Apr 2025aider.chatT2 History
40#40GPT-4o (2024-11-20)OpenAI95.1%date=2024-12-30 · command=aider --model gpt-4o-2024-11-20 · dirname=2024-12-30-20-57-12--gpt-4o-2024-11-20-ex-as-sys · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
41#41o3 (high)94.7%date=2025-06-25 · command=aider --model o3 --reasoning-effort high · dirname=2025-06-25-21-04-24--o3-price-reduction-high · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
42#42R1 0528DeepSeek94.6%date=2025-06-06 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-06-06-16-47-07--r1-diff · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
43#43gpt-4.1-nanoOpenAI94.2%date=2025-04-14 · command=aider --model gpt-4.1-nano · dirname=2025-04-14-22-46-01--gpt41nano-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
44#44GPT-4o (2024-08-06)OpenAI94.2%date=2024-12-30 · command=aider --model gpt-4o-2024-08-06 · dirname=2024-12-30-20-44-54--gpt4o-ex-as-sys-clean-prompt · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
45#45o3OpenAI93.8%date=2025-06-25 · command=aider --model o3 · dirname=2025-06-25-20-30-16--o3-price-reduction · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
46#46gemini-2.5-flash-preview-05-20 (no think)93.8%date=2025-05-26 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-26-15-56-31--flash25-05-20-24k-think · versions=0.83.3.dev26 May 2025aider.chatT2 History
47#47o3 Mini HighOpenAI93.3%date=2025-01-31 · command=aider --model o3-mini --reasoning-effort high · dirname=2025-01-31-20-42-47--o3-mini-diff-high · versions=0.72.4.dev31 Jan 2025aider.chatT2 History
48#48chatgpt-4o-latest (2025-02-15)93.3%date=2025-02-15 · command=aider --model chatgpt-4o-latest · dirname=2025-02-15-19-51-22--chatgpt4o-feb15-diff · versions=0.74.3.dev15 Feb 2025aider.chatT2 History
49#49claude-3-7-sonnet-20250219 (no thinking)93.3%date=2025-02-24 · command=aider --model sonnet · dirname=2025-02-24-19-54-07--sonnet37-diff · versions=0.74.4.dev24 Feb 2025aider.chatT2 History
50#50DeepSeek Chat V2.592.9%date=2024-12-21 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-21-20-56-21--polyglot-deepseek-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
51#51Qwen3 235B A22B diff, no think, Alibaba API92.9%date=2025-05-09 · command=aider --model openai/qwen3-235b-a22b · dirname=2025-05-09-17-02-02--qwen3-235b-a22b.unthink_16k_diff · versions=0.82.4.dev9 May 2025aider.chatT2 History
52#52Kimi K2 0711Moonshot AI92.9%date=2025-07-17 · command=aider --model openrouter/moonshotai/kimi-k2 · dirname=2025-07-17-17-41-54--kimi-k2-diff-or-pricing · versions=0.85.3.dev17 Jul 2025aider.chatT2 History
53#53yi-lightning92.9%date=2024-12-23 · command=aider --model openai/yi-lightning · dirname=2024-12-23-01-11-56--yi-test · versions=0.69.2.dev23 Dec 2024aider.chatT2 History
54#54Gemini 2.5 Pro Preview 03-2592.4%date=2025-04-12 · command=aider --model gemini/gemini-2.5-pro-preview-03-25 · dirname=2025-04-12-04-55-50--gemini-25-pro-diff-fenced · versions=0.81.3.dev12 Apr 2025aider.chatT2 History
55#55gpt-4.1-miniOpenAI92.4%date=2025-04-14 · command=aider --model gpt-4.1-mini · dirname=2025-04-14-21-27-53--gpt41mini-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
56#56gpt-5 (high)91.6%date=2025-08-23 · command=aider --model openai/gpt-5 · dirname=2025-08-23-15-47-21--gpt-5-high · versions=0.86.2.dev23 Aug 2025aider.chatT2 History
57#57o1-2024-12-17 (high)91.5%date=2024-12-21 · command=aider --model openrouter/openai/o1 · dirname=2024-12-21-19-23-03--polyglot-o1-hard-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
58#58Claude Haiku 3.5Anthropic91.1%date=2024-12-21 · command=aider --model claude-3-5-haiku-20241022 · dirname=2024-12-21-21-46-27--polyglot-haiku-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
59#59o4 Mini HighOpenAI90.7%date=2025-04-16 · command=aider --model o4-mini · dirname=2025-04-16-22-01-58--o4-mini-high-diff-exsys · versions=0.82.1.dev16 Apr 2025aider.chatT2 History
60#60qwen-max-2025-01-2590.2%date=2025-01-28 · command=OPENAI_API_BASE=https://dashscope-intl.aliyuncs.com/compatible-mode/v1 aider --model openai/qwen-max-2025-01-25 · dirname=2025-01-28-16-00-03--qwen-max-2025-01-25-polyglot-diff · versions=0.72.4.dev28 Jan 2025aider.chatT2 History
61#61gpt-5 (medium)OpenAI88.4%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-13-23-27--gpt-5-medium · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
62#62gpt-5 (high)88%date=2025-08-23 · command=aider --model openai/gpt-5 · dirname=2025-08-23-15-47-21--gpt-5-high · versions=0.86.2.dev23 Aug 2025aider.chatT2 History
63#63gpt-5 (medium)OpenAI86.7%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-13-23-27--gpt-5-medium · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
64#64gpt-5 (low)OpenAI86.7%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-14-16-37--gpt-5-low · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
65#65gemini-2.5-flash-preview-04-17 (default)85.3%date=2025-04-20 · command=aider --model gemini/gemini-2.5-flash-preview-04-17 · dirname=2025-04-20-19-54-31--flash25-diff-no-think · versions=0.82.3.dev20 Apr 2025aider.chatT2 History
66#66o3-pro (high)84.9%date=2025-06-28 · command=aider --model o3-pro · dirname=2025-06-28-00-38-18--o3-pro-high · versions=0.85.1.dev28 Jun 2025aider.chatT2 History
67#67Qwen3 32BQwen83.6%date=2025-05-08 · command=aider --model openrouter/qwen/qwen3-32b · dirname=2025-05-08-03-20-24--qwen3-32b-default · versions=0.82.4.dev8 May 2025aider.chatT2 History
68#68gemini-2.5-pro-preview-06-05 (32k think)83.1%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 --thinking-tokens 32k · dirname=2025-06-06-16-36-21--gemini0605-32k-think-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
69#69o3 (high)81.3%date=2025-06-25 · command=aider --model o3 --reasoning-effort high · dirname=2025-06-25-21-04-24--o3-price-reduction-high · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
70#70gpt-5 (low)OpenAI81.3%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-14-16-37--gpt-5-low · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
71#71grok-4 (high)79.6%date=2025-07-11 · command=aider --model openrouter/x-ai/grok-4 · dirname=2025-07-11-19-37-40--xai-or-grok4-high · versions=0.85.2.dev11 Jul 2025aider.chatT2 History
72#72gemini-2.5-pro-preview-06-05 (default think)79.1%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 · dirname=2025-06-06-18-38-56--gemini0605-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
73#73gpt-oss-120b (high)79.1%date=2025-08-06 · command=aider --model openrouter/openai/gpt-oss-120b --reasoning-effort high · dirname=2025-08-06-04-54-48--gpt-oss-120b-high-polyglot · versions=0.85.3.dev6 Aug 2025aider.chatT2 History
74#74o3 (high) + gpt-4.178.2%date=2025-06-27 · command=aider --model o3 · dirname=2025-06-27-23-53-57--o3-mini-high-diff-arch · versions=0.85.1.dev27 Jun 2025aider.chatT2 History
75#75gemini-2.0-flash-thinking-exp-01-21Google77.8%date=2025-01-21 · command=aider --model gemini/gemini-2.0-flash-thinking-exp-01-21 · dirname=2025-01-21-22-51-49--gemini-2.0-flash-thinking-exp-01-21-polyglot-diff · versions=0.72.2.dev21 Jan 2025aider.chatT2 History
76#76Gemini 2.5 Pro Preview 05-06Google76.9%date=2025-05-07 · command=aider --model gemini/gemini-2.5-pro-preview-05-06 · dirname=2025-05-07-19-32-40--gemini0506-diff-fenced-completion_cost · versions=0.82.4.dev7 May 2025aider.chatT2 History
77#77o3OpenAI76.9%date=2025-06-25 · command=aider --model o3 · dirname=2025-06-25-20-30-16--o3-price-reduction · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
78#78DeepSeek-V3.2-Exp (Reasoner)74.2%date=2025-10-03 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-10-03-09-45-34--deepseek-v3.2-reasoner · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
79#79Gemini 2.5 Pro Preview 03-2572.9%date=2025-04-12 · command=aider --model gemini/gemini-2.5-pro-preview-03-25 · dirname=2025-04-12-04-55-50--gemini-25-pro-diff-fenced · versions=0.81.3.dev12 Apr 2025aider.chatT2 History
80#80claude-opus-4-20250514 (32k thinking)72%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-20-40-51--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
81#81o4 Mini HighOpenAI72%date=2025-04-16 · command=aider --model o4-mini · dirname=2025-04-16-22-01-58--o4-mini-high-diff-exsys · versions=0.82.1.dev16 Apr 2025aider.chatT2 History
82#82Qwen2.5 Coder 32B InstructQwen71.6%date=2024-12-22 · command=aider --model openai/Qwen/Qwen2.5-Coder-32B-Instruct # via hyperbolic · dirname=2024-12-22-13-22-32--polyglot-qwen-diff · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
83#83R1 0528DeepSeek71.4%date=2025-06-06 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-06-06-16-47-07--r1-diff · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
84#84claude-opus-4-20250514 (no think)70.7%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-19-57-20--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
85#85DeepSeek-V3.2-Exp (Chat)70.2%date=2025-10-03 · command=aider --model deepseek/deepseek-chat · dirname=2025-10-03-09-21-36--deepseek-v3.2-chat · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
86#86QwQ-32BAlibaba Group67.6%date=2025-03-06 · command=aider --model fireworks_ai/accounts/fireworks/models/qwq-32b · dirname=2025-03-06-17-40-24--qwq32b-diff-temp-topp-ex-sys-remind-user-for-real · versions=0.75.3.dev6 Mar 2025aider.chatT2 History
87#87claude-3-7-sonnet-20250219 (32k thinking tokens)64.9%date=2025-02-24 · command=aider --model anthropic/claude-3-7-sonnet-20250219 --thinking-tokens 32k · dirname=2025-02-24-21-47-23--sonnet37-diff-think-32k-64k · versions=0.75.1.dev24 Feb 2025aider.chatT2 History
88#88chatgpt-4o-latest (2025-03-29)64.4%date=2025-03-29 · command=aider --model chatgpt-4o-latest · dirname=2025-03-29-05-24-55--chatgpt4o-mar28-diff · versions=0.79.3.dev29 Mar 2025aider.chatT2 History
89#89DeepSeek R1 + claude-3-5-sonnet-2024102264%date=2025-01-23 · command=aider --architect --model r1 --editor-model sonnet · dirname=2025-01-23-19-14-48--r1-architect-sonnet · versions=0.72.3.dev23 Jan 2025aider.chatT2 History
90#90o1-2024-12-17 (high)61.7%date=2024-12-21 · command=aider --model openrouter/openai/o1 · dirname=2024-12-21-19-23-03--polyglot-o1-hard-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
91#91claude-sonnet-4-20250514 (32k thinking)61.3%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-22-10-36--sonnet4-diff-exuser-think32k · versions=0.83.3.dev24 May 2025aider.chatT2 History
92#92claude-3-7-sonnet-20250219 (no thinking)60.4%date=2025-02-24 · command=aider --model sonnet · dirname=2025-02-24-19-54-07--sonnet37-diff · versions=0.74.4.dev24 Feb 2025aider.chatT2 History
93#93o3 Mini HighOpenAI60.4%date=2025-01-31 · command=aider --model o3-mini --reasoning-effort high · dirname=2025-01-31-20-42-47--o3-mini-diff-high · versions=0.72.4.dev31 Jan 2025aider.chatT2 History
94#94Qwen3 235B A22B diff, no think, Alibaba API59.6%date=2025-05-09 · command=aider --model openai/qwen3-235b-a22b · dirname=2025-05-09-17-02-02--qwen3-235b-a22b.unthink_16k_diff · versions=0.82.4.dev9 May 2025aider.chatT2 History
95#95Kimi K2 0711Moonshot AI59.1%date=2025-07-17 · command=aider --model openrouter/moonshotai/kimi-k2 · dirname=2025-07-17-17-41-54--kimi-k2-diff-or-pricing · versions=0.85.3.dev17 Jul 2025aider.chatT2 History
96#96R1DeepSeek56.9%date=2025-01-20 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-01-20-19-11-38--ds-turns-upd-cur-msgs-fix-with-summarizer · versions=0.71.2.dev20 Jan 2025aider.chatT2 History
97#97claude-sonnet-4-20250514 (no thinking)56.4%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-21-17-54--sonnet4-diff-exuser · versions=0.83.3.dev24 May 2025aider.chatT2 History
98#98gemini-2.5-flash-preview-05-20 (24k think)55.1%date=2025-05-25 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-25-22-58-44--flash25-05-20-24k-think · versions=0.83.3.dev25 May 2025aider.chatT2 History
99#99DeepSeek V3 0324DeepSeek55.1%date=2025-03-24 · command=aider --model deepseek/deepseek-chat · dirname=2025-03-24-15-41-33--deepseek-v3-0324-polyglot-diff · versions=0.78.1.dev24 Mar 2025aider.chatT2 History
100#100Quasar Alpha54.7%date=2025-04-04 · command=aider --model openrouter/openrouter/quasar-alpha · dirname=2025-04-04-02-57-25--qalpha-diff-exsys · versions=0.80.5.dev4 Apr 2025aider.chatT2 History

Scores are reported as published, with their evaluation configuration (harness, prompting, judge). The bar is relative to the best score on this page. Results with different configs are not directly comparable — see methodology.

The config filter matches a value inside each result's configuration (server-side, `config=` on the API). Chips are the values shared by several rows on the first page; per-model identifiers are not offered.