Skip to content
AI Atlas
BenchmarkActivecategory · coding

Aider polyglot

aider.chat/docs/leaderboards

225 Exercism exercises in 6 languages, edit-format aware

quality57

Updated 3 h ago · first seen 11 Sept 2026

bench_01M293SPEMVE6W55699099NES3

Metric
pass rate (2 attempts) · %
Direction
Higher is better
Results
138 · 126 filtered
Leader
QwQ-32B + Qwen 2.5 Coder Instruct 100%

Leaderboard 126 current results · config contains “225”

Select models with +, then open Compare.

Leaderboard
#ModelScoreConfigEvaluatedSourceActions
1#1Gemini 2.0 Pro exp-02-05100%date=2025-02-25 · command=aider --model gemini/gemini-2.0-pro-exp-02-05 · dirname=2025-02-25-20-23-07--gemini-pro · versions=0.75.2.dev25 Feb 2025aider.chatT2 History
2#2GPT-4o-mini (2024-07-18)OpenAI100%date=2024-12-21 · command=aider --model gpt-4o-mini-2024-07-18 · dirname=2024-12-21-18-41-18--polyglot-gpt-4o-mini · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
3#3Gemma 3 27BGoogle100%date=2025-03-15 · command=aider --model openrouter/google/gemma-3-27b-it · dirname=2025-03-15-01-21-24--gemma3-27b-or · versions=0.77.1.dev15 Mar 2025aider.chatT2 History
4#4DeepSeek R1 + claude-3-5-sonnet-20241022100%date=2025-01-23 · command=aider --architect --model r1 --editor-model sonnet · dirname=2025-01-23-19-14-48--r1-architect-sonnet · versions=0.72.3.dev23 Jan 2025aider.chatT2 History
5#5gemini-2.5-pro-preview-06-05 (default think)100%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 · dirname=2025-06-06-18-38-56--gemini0605-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
6#6Grok 3 Mini Beta (low)100%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-mini-beta · dirname=2025-04-10-18-47-24--grok3-mini-whole-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
7#7Codestral 25.01Mistral AI100%date=2025-01-13 · command=aider --model mistral/codestral-latest · dirname=2025-01-13-18-17-25--codestral-whole2 · versions=0.71.2.dev13 Jan 2025aider.chatT2 History
8#8QwQ-32B + Qwen 2.5 Coder Instruct100%date=2025-03-07 · command=aider --model fireworks_ai/accounts/fireworks/models/qwq-32b --architect · dirname=2025-03-07-15-11-27--qwq32b-arch-temp-topp-again · versions=0.75.3.dev7 Mar 2025aider.chatT2 History
9#9gemini-2.0-flash-expGoogle100%date=2024-12-22 · command=aider --model gemini/gemini-2.0-flash-exp · dirname=2024-12-22-20-08-13--gemini-2.0-flash-exp-polyglot-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
10#10DeepSeek V3 0324DeepSeek99.6%date=2025-03-24 · command=aider --model deepseek/deepseek-chat · dirname=2025-03-24-15-41-33--deepseek-v3-0324-polyglot-diff · versions=0.78.1.dev24 Mar 2025aider.chatT2 History
11#11claude-3-5-sonnet-20241022Anthropic99.6%date=2025-01-17 · command=aider --model claude-3-5-sonnet-20241022 · dirname=2025-01-17-19-44-33--sonnet-baseline-jan-17 · versions=0.71.2.dev17 Jan 2025aider.chatT2 History
12#12Qwen2.5 Coder 32B InstructQwen99.6%date=2024-12-26 · command=aider --model openai/Qwen2.5-Coder-32B-Instruct · dirname=2024-12-26-00-55-20--Qwen2.5-Coder-32B-Instruct · versions=0.69.2.dev26 Dec 2024aider.chatT2 History
13#13Grok 3 Beta99.6%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-beta · dirname=2025-04-10-04-21-31--grok3-diff-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
14#14Grok 3 Mini Beta (high)99.6%date=2025-04-10 · command=aider --model xai/grok-3-mini-beta --reasoning-effort high · dirname=2025-04-10-23-59-02--xai-grok3-mini-whole-high · versions=0.81.3.dev10 Apr 2025aider.chatT2 History
15#15command-a-03-2025-quality99.6%date=2025-03-14 · command=OPENAI_API_BASE=https://api.cohere.ai/compatibility/v1 aider --model openai/command-a-03-2025-quality · dirname=2025-03-14-23-40-00--cmda-quality-whole2 · versions=0.77.1.dev14 Mar 2025aider.chatT2 History
16#16gemini-2.5-pro-preview-06-05 (32k think)99.6%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 --thinking-tokens 32k · dirname=2025-06-06-16-36-21--gemini0605-32k-think-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
17#17Llama 4 MaverickMeta AI99.1%date=2025-04-06 · command=aider --model nvidia_nim/meta/llama-4-maverick-17b-128e-instruct · dirname=2025-04-06-08-39-52--llama-4-maverick-17b-128e-instruct-polyglot-whole · versions=0.81.2.dev6 Apr 2025aider.chatT2 History
18#18DeepSeek Chat V3 (prev)98.7%date=2024-12-25 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-25-13-31-51--deepseekv3preview-diff2 · versions=0.69.2.dev25 Dec 2024aider.chatT2 History
19#19claude-opus-4-20250514 (no think)98.7%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-19-57-20--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
20#20DeepSeek-V3.2-Exp (Chat)98.2%date=2025-10-03 · command=aider --model deepseek/deepseek-chat · dirname=2025-10-03-09-21-36--deepseek-v3.2-chat · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
21#21claude-sonnet-4-20250514 (no thinking)98.2%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-21-17-54--sonnet4-diff-exuser · versions=0.83.3.dev24 May 2025aider.chatT2 History
22#22Quasar Alpha98.2%date=2025-04-04 · command=aider --model openrouter/openrouter/quasar-alpha · dirname=2025-04-04-02-57-25--qalpha-diff-exsys · versions=0.80.5.dev4 Apr 2025aider.chatT2 History
23#23gpt-4.1OpenAI98.2%date=2025-04-14 · command=aider --model gpt-4.1 · dirname=2025-04-14-21-05-54--gpt41-diff-exuser · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
24#24gemini-exp-120698.2%date=2024-12-22 · command=aider --model gemini/gemini-exp-1206 · dirname=2024-12-22-18-43-25--gemini-exp-1206-polyglot-whole-2 · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
25#25o3-pro (high)97.8%date=2025-06-28 · command=aider --model o3-pro · dirname=2025-06-28-00-38-18--o3-pro-high · versions=0.85.1.dev28 Jun 2025aider.chatT2 History
26#26claude-3-7-sonnet-20250219 (32k thinking tokens)97.8%date=2025-02-24 · command=aider --model anthropic/claude-3-7-sonnet-20250219 --thinking-tokens 32k · dirname=2025-02-24-21-47-23--sonnet37-diff-think-32k-64k · versions=0.75.1.dev24 Feb 2025aider.chatT2 History
27#27claude-opus-4-20250514 (32k thinking)97.3%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-20-40-51--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
28#28claude-sonnet-4-20250514 (32k thinking)97.3%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-22-10-36--sonnet4-diff-exuser-think32k · versions=0.83.3.dev24 May 2025aider.chatT2 History
29#29Optimus Alpha97.3%date=2025-04-10 · command=aider --model openrouter/openrouter/optimus-alpha · dirname=2025-04-10-19-02-44--oalpha-diff-exsys · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
30#30Gemini 2.5 Pro Preview 05-06Google97.3%date=2025-05-07 · command=aider --model gemini/gemini-2.5-pro-preview-05-06 · dirname=2025-05-07-19-32-40--gemini0506-diff-fenced-completion_cost · versions=0.82.4.dev7 May 2025aider.chatT2 History
31#31grok-4 (high)97.3%date=2025-07-11 · command=aider --model openrouter/x-ai/grok-4 · dirname=2025-07-11-19-37-40--xai-or-grok4-high · versions=0.85.2.dev11 Jul 2025aider.chatT2 History
32#32DeepSeek-V3.2-Exp (Reasoner)97.3%date=2025-10-03 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-10-03-09-45-34--deepseek-v3.2-reasoner · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
33#33o1-mini-2024-09-1296.9%date=2024-12-22 · command=aider --model o1-mini · dirname=2024-12-22-21-26-35--polyglot-o1mini-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
34#34R1DeepSeek96.9%date=2025-01-20 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-01-20-19-11-38--ds-turns-upd-cur-msgs-fix-with-summarizer · versions=0.71.2.dev20 Jan 2025aider.chatT2 History
35#35gemini-2.5-flash-preview-05-20 (24k think)95.6%date=2025-05-25 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-25-22-58-44--flash25-05-20-24k-think · versions=0.83.3.dev25 May 2025aider.chatT2 History
36#36GPT-4o (2024-11-20)OpenAI95.1%date=2024-12-30 · command=aider --model gpt-4o-2024-11-20 · dirname=2024-12-30-20-57-12--gpt-4o-2024-11-20-ex-as-sys · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
37#37openhands-lm-32b-v0.195.1%date=2025-04-19 · command=aider --model openrouter/all-hands/openhands-lm-32b-v0.1 · dirname=2025-04-19-14-43-04--o4-mini-patch · versions=0.82.2.dev19 Apr 2025aider.chatT2 History
38#38o3-mini (medium)95.1%date=2025-01-31 · command=aider --model o3-mini · dirname=2025-01-31-20-27-46--o3-mini-diff2 · versions=0.72.4.dev31 Jan 2025aider.chatT2 History
39#39o3 (high)94.7%date=2025-06-25 · command=aider --model o3 --reasoning-effort high · dirname=2025-06-25-21-04-24--o3-price-reduction-high · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
40#40gpt-4.1-nanoOpenAI94.2%date=2025-04-14 · command=aider --model gpt-4.1-nano · dirname=2025-04-14-22-46-01--gpt41nano-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
41#41GPT-4o (2024-08-06)OpenAI94.2%date=2024-12-30 · command=aider --model gpt-4o-2024-08-06 · dirname=2024-12-30-20-44-54--gpt4o-ex-as-sys-clean-prompt · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
42#42gemini-2.5-flash-preview-05-20 (no think)93.8%date=2025-05-26 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-26-15-56-31--flash25-05-20-24k-think · versions=0.83.3.dev26 May 2025aider.chatT2 History
43#43o3OpenAI93.8%date=2025-06-25 · command=aider --model o3 · dirname=2025-06-25-20-30-16--o3-price-reduction · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
44#44claude-3-7-sonnet-20250219 (no thinking)93.3%date=2025-02-24 · command=aider --model sonnet · dirname=2025-02-24-19-54-07--sonnet37-diff · versions=0.74.4.dev24 Feb 2025aider.chatT2 History
45#45Qwen3 235B A22B diff, no think, Alibaba API92.9%date=2025-05-09 · command=aider --model openai/qwen3-235b-a22b · dirname=2025-05-09-17-02-02--qwen3-235b-a22b.unthink_16k_diff · versions=0.82.4.dev9 May 2025aider.chatT2 History
46#46Kimi K2 0711Moonshot AI92.9%date=2025-07-17 · command=aider --model openrouter/moonshotai/kimi-k2 · dirname=2025-07-17-17-41-54--kimi-k2-diff-or-pricing · versions=0.85.3.dev17 Jul 2025aider.chatT2 History
47#47yi-lightning92.9%date=2024-12-23 · command=aider --model openai/yi-lightning · dirname=2024-12-23-01-11-56--yi-test · versions=0.69.2.dev23 Dec 2024aider.chatT2 History
48#48DeepSeek Chat V2.592.9%date=2024-12-21 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-21-20-56-21--polyglot-deepseek-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
49#49Gemini 2.5 Pro Preview 03-2592.4%date=2025-04-12 · command=aider --model gemini/gemini-2.5-pro-preview-03-25 · dirname=2025-04-12-04-55-50--gemini-25-pro-diff-fenced · versions=0.81.3.dev12 Apr 2025aider.chatT2 History
50#50gpt-4.1-miniOpenAI92.4%date=2025-04-14 · command=aider --model gpt-4.1-mini · dirname=2025-04-14-21-27-53--gpt41mini-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
51#51gpt-5 (high)91.6%date=2025-08-23 · command=aider --model openai/gpt-5 · dirname=2025-08-23-15-47-21--gpt-5-high · versions=0.86.2.dev23 Aug 2025aider.chatT2 History
52#52Claude Haiku 3.5Anthropic91.1%date=2024-12-21 · command=aider --model claude-3-5-haiku-20241022 · dirname=2024-12-21-21-46-27--polyglot-haiku-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
53#53o4 Mini HighOpenAI90.7%date=2025-04-16 · command=aider --model o4-mini · dirname=2025-04-16-22-01-58--o4-mini-high-diff-exsys · versions=0.82.1.dev16 Apr 2025aider.chatT2 History
54#54qwen-max-2025-01-2590.2%date=2025-01-28 · command=OPENAI_API_BASE=https://dashscope-intl.aliyuncs.com/compatible-mode/v1 aider --model openai/qwen-max-2025-01-25 · dirname=2025-01-28-16-00-03--qwen-max-2025-01-25-polyglot-diff · versions=0.72.4.dev28 Jan 2025aider.chatT2 History
55#55gpt-5 (medium)OpenAI88.4%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-13-23-27--gpt-5-medium · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
56#56gpt-5 (high)88%date=2025-08-23 · command=aider --model openai/gpt-5 · dirname=2025-08-23-15-47-21--gpt-5-high · versions=0.86.2.dev23 Aug 2025aider.chatT2 History
57#57gpt-5 (low)OpenAI86.7%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-14-16-37--gpt-5-low · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
58#58gpt-5 (medium)OpenAI86.7%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-13-23-27--gpt-5-medium · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
59#59gemini-2.5-flash-preview-04-17 (default)85.3%date=2025-04-20 · command=aider --model gemini/gemini-2.5-flash-preview-04-17 · dirname=2025-04-20-19-54-31--flash25-diff-no-think · versions=0.82.3.dev20 Apr 2025aider.chatT2 History
60#60o3-pro (high)84.9%date=2025-06-28 · command=aider --model o3-pro · dirname=2025-06-28-00-38-18--o3-pro-high · versions=0.85.1.dev28 Jun 2025aider.chatT2 History
61#61Qwen3 32BQwen83.6%date=2025-05-08 · command=aider --model openrouter/qwen/qwen3-32b · dirname=2025-05-08-03-20-24--qwen3-32b-default · versions=0.82.4.dev8 May 2025aider.chatT2 History
62#62gemini-2.5-pro-preview-06-05 (32k think)83.1%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 --thinking-tokens 32k · dirname=2025-06-06-16-36-21--gemini0605-32k-think-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
63#63gpt-5 (low)OpenAI81.3%date=2025-08-25 · command=aider --model openai/gpt-5 · dirname=2025-08-25-14-16-37--gpt-5-low · versions=0.86.2.dev25 Aug 2025aider.chatT2 History
64#64o3 (high)81.3%date=2025-06-25 · command=aider --model o3 --reasoning-effort high · dirname=2025-06-25-21-04-24--o3-price-reduction-high · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
65#65grok-4 (high)79.6%date=2025-07-11 · command=aider --model openrouter/x-ai/grok-4 · dirname=2025-07-11-19-37-40--xai-or-grok4-high · versions=0.85.2.dev11 Jul 2025aider.chatT2 History
66#66gemini-2.5-pro-preview-06-05 (default think)79.1%date=2025-06-06 · command=aider --model gemini/gemini-2.5-pro-preview-06-05 · dirname=2025-06-06-18-38-56--gemini0605-diff-fenced · versions=0.84.1.dev6 Jun 2025aider.chatT2 History
67#67gpt-oss-120b (high)79.1%date=2025-08-06 · command=aider --model openrouter/openai/gpt-oss-120b --reasoning-effort high · dirname=2025-08-06-04-54-48--gpt-oss-120b-high-polyglot · versions=0.85.3.dev6 Aug 2025aider.chatT2 History
68#68gemini-2.0-flash-thinking-exp-01-21Google77.8%date=2025-01-21 · command=aider --model gemini/gemini-2.0-flash-thinking-exp-01-21 · dirname=2025-01-21-22-51-49--gemini-2.0-flash-thinking-exp-01-21-polyglot-diff · versions=0.72.2.dev21 Jan 2025aider.chatT2 History
69#69o3OpenAI76.9%date=2025-06-25 · command=aider --model o3 · dirname=2025-06-25-20-30-16--o3-price-reduction · versions=0.84.1.dev25 Jun 2025aider.chatT2 History
70#70Gemini 2.5 Pro Preview 05-06Google76.9%date=2025-05-07 · command=aider --model gemini/gemini-2.5-pro-preview-05-06 · dirname=2025-05-07-19-32-40--gemini0506-diff-fenced-completion_cost · versions=0.82.4.dev7 May 2025aider.chatT2 History
71#71DeepSeek-V3.2-Exp (Reasoner)74.2%date=2025-10-03 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-10-03-09-45-34--deepseek-v3.2-reasoner · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
72#72Gemini 2.5 Pro Preview 03-2572.9%date=2025-04-12 · command=aider --model gemini/gemini-2.5-pro-preview-03-25 · dirname=2025-04-12-04-55-50--gemini-25-pro-diff-fenced · versions=0.81.3.dev12 Apr 2025aider.chatT2 History
73#73o4 Mini HighOpenAI72%date=2025-04-16 · command=aider --model o4-mini · dirname=2025-04-16-22-01-58--o4-mini-high-diff-exsys · versions=0.82.1.dev16 Apr 2025aider.chatT2 History
74#74claude-opus-4-20250514 (32k thinking)72%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-20-40-51--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
75#75Qwen2.5 Coder 32B InstructQwen71.6%date=2024-12-22 · command=aider --model openai/Qwen/Qwen2.5-Coder-32B-Instruct # via hyperbolic · dirname=2024-12-22-13-22-32--polyglot-qwen-diff · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
76#76claude-opus-4-20250514 (no think)70.7%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-19-57-20--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
77#77DeepSeek-V3.2-Exp (Chat)70.2%date=2025-10-03 · command=aider --model deepseek/deepseek-chat · dirname=2025-10-03-09-21-36--deepseek-v3.2-chat · versions=0.86.2.dev3 Oct 2025aider.chatT2 History
78#78QwQ-32BAlibaba Group67.6%date=2025-03-06 · command=aider --model fireworks_ai/accounts/fireworks/models/qwq-32b · dirname=2025-03-06-17-40-24--qwq32b-diff-temp-topp-ex-sys-remind-user-for-real · versions=0.75.3.dev6 Mar 2025aider.chatT2 History
79#79claude-3-7-sonnet-20250219 (32k thinking tokens)64.9%date=2025-02-24 · command=aider --model anthropic/claude-3-7-sonnet-20250219 --thinking-tokens 32k · dirname=2025-02-24-21-47-23--sonnet37-diff-think-32k-64k · versions=0.75.1.dev24 Feb 2025aider.chatT2 History
80#80chatgpt-4o-latest (2025-03-29)64.4%date=2025-03-29 · command=aider --model chatgpt-4o-latest · dirname=2025-03-29-05-24-55--chatgpt4o-mar28-diff · versions=0.79.3.dev29 Mar 2025aider.chatT2 History
81#81DeepSeek R1 + claude-3-5-sonnet-2024102264%date=2025-01-23 · command=aider --architect --model r1 --editor-model sonnet · dirname=2025-01-23-19-14-48--r1-architect-sonnet · versions=0.72.3.dev23 Jan 2025aider.chatT2 History
82#82claude-sonnet-4-20250514 (32k thinking)61.3%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-22-10-36--sonnet4-diff-exuser-think32k · versions=0.83.3.dev24 May 2025aider.chatT2 History
83#83claude-3-7-sonnet-20250219 (no thinking)60.4%date=2025-02-24 · command=aider --model sonnet · dirname=2025-02-24-19-54-07--sonnet37-diff · versions=0.74.4.dev24 Feb 2025aider.chatT2 History
84#84Qwen3 235B A22B diff, no think, Alibaba API59.6%date=2025-05-09 · command=aider --model openai/qwen3-235b-a22b · dirname=2025-05-09-17-02-02--qwen3-235b-a22b.unthink_16k_diff · versions=0.82.4.dev9 May 2025aider.chatT2 History
85#85Kimi K2 0711Moonshot AI59.1%date=2025-07-17 · command=aider --model openrouter/moonshotai/kimi-k2 · dirname=2025-07-17-17-41-54--kimi-k2-diff-or-pricing · versions=0.85.3.dev17 Jul 2025aider.chatT2 History
86#86R1DeepSeek56.9%date=2025-01-20 · command=aider --model deepseek/deepseek-reasoner · dirname=2025-01-20-19-11-38--ds-turns-upd-cur-msgs-fix-with-summarizer · versions=0.71.2.dev20 Jan 2025aider.chatT2 History
87#87claude-sonnet-4-20250514 (no thinking)56.4%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-21-17-54--sonnet4-diff-exuser · versions=0.83.3.dev24 May 2025aider.chatT2 History
88#88gemini-2.5-flash-preview-05-20 (24k think)55.1%date=2025-05-25 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-25-22-58-44--flash25-05-20-24k-think · versions=0.83.3.dev25 May 2025aider.chatT2 History
89#89DeepSeek V3 0324DeepSeek55.1%date=2025-03-24 · command=aider --model deepseek/deepseek-chat · dirname=2025-03-24-15-41-33--deepseek-v3-0324-polyglot-diff · versions=0.78.1.dev24 Mar 2025aider.chatT2 History
90#90Quasar Alpha54.7%date=2025-04-04 · command=aider --model openrouter/openrouter/quasar-alpha · dirname=2025-04-04-02-57-25--qalpha-diff-exsys · versions=0.80.5.dev4 Apr 2025aider.chatT2 History
91#91o3-mini (medium)53.8%date=2025-01-31 · command=aider --model o3-mini · dirname=2025-01-31-20-27-46--o3-mini-diff2 · versions=0.72.4.dev31 Jan 2025aider.chatT2 History
92#92Grok 3 Beta53.3%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-beta · dirname=2025-04-10-04-21-31--grok3-diff-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
93#93Optimus Alpha52.9%date=2025-04-10 · command=aider --model openrouter/openrouter/optimus-alpha · dirname=2025-04-10-19-02-44--oalpha-diff-exsys · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
94#94gpt-4.1OpenAI52.4%date=2025-04-14 · command=aider --model gpt-4.1 · dirname=2025-04-14-21-05-54--gpt41-diff-exuser · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
95#95claude-3-5-sonnet-20241022Anthropic51.6%date=2025-01-17 · command=aider --model claude-3-5-sonnet-20241022 · dirname=2025-01-17-19-44-33--sonnet-baseline-jan-17 · versions=0.71.2.dev17 Jan 2025aider.chatT2 History
96#96Grok 3 Mini Beta (high)49.3%date=2025-04-10 · command=aider --model xai/grok-3-mini-beta --reasoning-effort high · dirname=2025-04-10-23-59-02--xai-grok3-mini-whole-high · versions=0.81.3.dev10 Apr 2025aider.chatT2 History
97#97DeepSeek Chat V3 (prev)48.4%date=2024-12-25 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-25-13-31-51--deepseekv3preview-diff2 · versions=0.69.2.dev25 Dec 2024aider.chatT2 History
98#98gemini-2.5-flash-preview-04-17 (default)47.1%date=2025-04-20 · command=aider --model gemini/gemini-2.5-flash-preview-04-17 · dirname=2025-04-20-19-54-31--flash25-diff-no-think · versions=0.82.3.dev20 Apr 2025aider.chatT2 History
99#99chatgpt-4o-latest (2025-03-29)45.3%date=2025-03-29 · command=aider --model chatgpt-4o-latest · dirname=2025-03-29-05-24-55--chatgpt4o-mar28-diff · versions=0.79.3.dev29 Mar 2025aider.chatT2 History
100#100gemini-2.5-flash-preview-05-20 (no think)44%date=2025-05-26 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-26-15-56-31--flash25-05-20-24k-think · versions=0.83.3.dev26 May 2025aider.chatT2 History

Scores are reported as published, with their evaluation configuration (harness, prompting, judge). The bar is relative to the best score on this page. Results with different configs are not directly comparable — see methodology.

The config filter matches a value inside each result's configuration (server-side, `config=` on the API). Chips are the values shared by several rows on the first page; per-model identifiers are not offered.