Skip to content
AI Atlas
BenchmarkActivecategory · coding

Aider polyglot

aider.chat/docs/leaderboards

225 Exercism exercises in 6 languages, edit-format aware

quality57

Updated 3 h ago · first seen 11 Sept 2026

bench_01M293SPEMVE6W55699099NES3

Metric
pass rate (2 attempts) · %
Direction
Higher is better
Results
138
Leader
QwQ-32B + Qwen 2.5 Coder Instruct 100%

Leaderboard 138 current results

Select models with +, then open Compare.

Leaderboard
#ModelScoreConfigEvaluatedSourceActions
101#101o3-mini (medium)53.8%date=2025-01-31 · command=aider --model o3-mini · dirname=2025-01-31-20-27-46--o3-mini-diff2 · versions=0.72.4.dev31 Jan 2025aider.chatT2 History
102#102Grok 3 Beta53.3%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-beta · dirname=2025-04-10-04-21-31--grok3-diff-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
103#103Optimus Alpha52.9%date=2025-04-10 · command=aider --model openrouter/openrouter/optimus-alpha · dirname=2025-04-10-19-02-44--oalpha-diff-exsys · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
104#104gpt-4.1OpenAI52.4%date=2025-04-14 · command=aider --model gpt-4.1 · dirname=2025-04-14-21-05-54--gpt41-diff-exuser · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
105#105claude-3-5-sonnet-20241022Anthropic51.6%date=2025-01-17 · command=aider --model claude-3-5-sonnet-20241022 · dirname=2025-01-17-19-44-33--sonnet-baseline-jan-17 · versions=0.71.2.dev17 Jan 2025aider.chatT2 History
106#106Grok 3 Mini Beta (high)49.3%date=2025-04-10 · command=aider --model xai/grok-3-mini-beta --reasoning-effort high · dirname=2025-04-10-23-59-02--xai-grok3-mini-whole-high · versions=0.81.3.dev10 Apr 2025aider.chatT2 History
107#107DeepSeek Chat V3 (prev)48.4%date=2024-12-25 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-25-13-31-51--deepseekv3preview-diff2 · versions=0.69.2.dev25 Dec 2024aider.chatT2 History
108#108gemini-2.5-flash-preview-04-17 (default)47.1%date=2025-04-20 · command=aider --model gemini/gemini-2.5-flash-preview-04-17 · dirname=2025-04-20-19-54-31--flash25-diff-no-think · versions=0.82.3.dev20 Apr 2025aider.chatT2 History
109#109chatgpt-4o-latest (2025-03-29)45.3%date=2025-03-29 · command=aider --model chatgpt-4o-latest · dirname=2025-03-29-05-24-55--chatgpt4o-mar28-diff · versions=0.79.3.dev29 Mar 2025aider.chatT2 History
110#110GPT-4.5 PreviewOpenAI44.9%date=2025-02-27 · command=aider --model openai/gpt-4.5-preview · dirname=2025-02-27-20-26-15--gpt45-diff3 · versions=0.75.2.dev27 Feb 2025aider.chatT2 History
111#111gemini-2.5-flash-preview-05-20 (no think)44%date=2025-05-26 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-26-15-56-31--flash25-05-20-24k-think · versions=0.83.3.dev26 May 2025aider.chatT2 History
112#112gpt-oss-120b (high)41.8%date=2025-08-06 · command=aider --model openrouter/openai/gpt-oss-120b --reasoning-effort high · dirname=2025-08-06-04-54-48--gpt-oss-120b-high-polyglot · versions=0.85.3.dev6 Aug 2025aider.chatT2 History
113#113Qwen3 32BQwen40%date=2025-05-08 · command=aider --model openrouter/qwen/qwen3-32b · dirname=2025-05-08-03-20-24--qwen3-32b-default · versions=0.82.4.dev8 May 2025aider.chatT2 History
114#114gemini-exp-120638.2%date=2024-12-22 · command=aider --model gemini/gemini-exp-1206 · dirname=2024-12-22-18-43-25--gemini-exp-1206-polyglot-whole-2 · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
115#115Gemini 2.0 Pro exp-02-0535.6%date=2025-02-25 · command=aider --model gemini/gemini-2.0-pro-exp-02-05 · dirname=2025-02-25-20-23-07--gemini-pro · versions=0.75.2.dev25 Feb 2025aider.chatT2 History
116#116Grok 3 Mini Beta (low)34.7%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-mini-beta · dirname=2025-04-10-18-47-24--grok3-mini-whole-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
117#117o1-mini-2024-09-1232.9%date=2024-12-22 · command=aider --model o1-mini · dirname=2024-12-22-21-26-35--polyglot-o1mini-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
118#118gpt-4.1-miniOpenAI32.4%date=2025-04-14 · command=aider --model gpt-4.1-mini · dirname=2025-04-14-21-27-53--gpt41mini-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
119#119Claude Haiku 3.5Anthropic28%date=2024-12-21 · command=aider --model claude-3-5-haiku-20241022 · dirname=2024-12-21-21-46-27--polyglot-haiku-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
120#120chatgpt-4o-latest (2025-02-15)27.1%date=2025-02-15 · command=aider --model chatgpt-4o-latest · dirname=2025-02-15-19-51-22--chatgpt4o-feb15-diff · versions=0.74.3.dev15 Feb 2025aider.chatT2 History
121#121QwQ-32B + Qwen 2.5 Coder Instruct26.2%date=2025-03-07 · command=aider --model fireworks_ai/accounts/fireworks/models/qwq-32b --architect · dirname=2025-03-07-15-11-27--qwq32b-arch-temp-topp-again · versions=0.75.3.dev7 Mar 2025aider.chatT2 History
122#122GPT-4o (2024-08-06)OpenAI23.1%date=2024-12-30 · command=aider --model gpt-4o-2024-08-06 · dirname=2024-12-30-20-44-54--gpt4o-ex-as-sys-clean-prompt · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
123#123gemini-2.0-flash-expGoogle22.2%date=2024-12-22 · command=aider --model gemini/gemini-2.0-flash-exp · dirname=2024-12-22-20-08-13--gemini-2.0-flash-exp-polyglot-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
124#124qwen-max-2025-01-2521.8%date=2025-01-28 · command=OPENAI_API_BASE=https://dashscope-intl.aliyuncs.com/compatible-mode/v1 aider --model openai/qwen-max-2025-01-25 · dirname=2025-01-28-16-00-03--qwen-max-2025-01-25-polyglot-diff · versions=0.72.4.dev28 Jan 2025aider.chatT2 History
125#125QwQ-32BAlibaba Group20.9%date=2025-03-06 · command=aider --model fireworks_ai/accounts/fireworks/models/qwq-32b · dirname=2025-03-06-17-40-24--qwq32b-diff-temp-topp-ex-sys-remind-user-for-real · versions=0.75.3.dev6 Mar 2025aider.chatT2 History
126#126GPT-4o (2024-11-20)OpenAI18.2%date=2024-12-30 · command=aider --model gpt-4o-2024-11-20 · dirname=2024-12-30-20-57-12--gpt-4o-2024-11-20-ex-as-sys · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
127#127gemini-2.0-flash-thinking-exp-01-21Google18.2%date=2025-01-21 · command=aider --model gemini/gemini-2.0-flash-thinking-exp-01-21 · dirname=2025-01-21-22-51-49--gemini-2.0-flash-thinking-exp-01-21-polyglot-diff · versions=0.72.2.dev21 Jan 2025aider.chatT2 History
128#128DeepSeek Chat V2.517.8%date=2024-12-21 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-21-20-56-21--polyglot-deepseek-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
129#129Qwen2.5 Coder 32B InstructQwen16.4%date=2024-12-26 · command=aider --model openai/Qwen2.5-Coder-32B-Instruct · dirname=2024-12-26-00-55-20--Qwen2.5-Coder-32B-Instruct · versions=0.69.2.dev26 Dec 2024aider.chatT2 History
130#130Llama 4 MaverickMeta AI15.6%date=2025-04-06 · command=aider --model nvidia_nim/meta/llama-4-maverick-17b-128e-instruct · dirname=2025-04-06-08-39-52--llama-4-maverick-17b-128e-instruct-polyglot-whole · versions=0.81.2.dev6 Apr 2025aider.chatT2 History
131#131yi-lightning12.9%date=2024-12-23 · command=aider --model openai/yi-lightning · dirname=2024-12-23-01-11-56--yi-test · versions=0.69.2.dev23 Dec 2024aider.chatT2 History
132#132command-a-03-2025-quality12%date=2025-03-14 · command=OPENAI_API_BASE=https://api.cohere.ai/compatibility/v1 aider --model openai/command-a-03-2025-quality · dirname=2025-03-14-23-40-00--cmda-quality-whole2 · versions=0.77.1.dev14 Mar 2025aider.chatT2 History
133#133Codestral 25.01Mistral AI11.1%date=2025-01-13 · command=aider --model mistral/codestral-latest · dirname=2025-01-13-18-17-25--codestral-whole2 · versions=0.71.2.dev13 Jan 2025aider.chatT2 History
134#134openhands-lm-32b-v0.110.2%date=2025-04-19 · command=aider --model openrouter/all-hands/openhands-lm-32b-v0.1 · dirname=2025-04-19-14-43-04--o4-mini-patch · versions=0.82.2.dev19 Apr 2025aider.chatT2 History
135#135gpt-4.1-nanoOpenAI8.9%date=2025-04-14 · command=aider --model gpt-4.1-nano · dirname=2025-04-14-22-46-01--gpt41nano-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
136#136Qwen2.5 Coder 32B InstructQwen8%date=2024-12-22 · command=aider --model openai/Qwen/Qwen2.5-Coder-32B-Instruct # via hyperbolic · dirname=2024-12-22-13-22-32--polyglot-qwen-diff · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
137#137Gemma 3 27BGoogle4.9%date=2025-03-15 · command=aider --model openrouter/google/gemma-3-27b-it · dirname=2025-03-15-01-21-24--gemma3-27b-or · versions=0.77.1.dev15 Mar 2025aider.chatT2 History
138#138GPT-4o-mini (2024-07-18)OpenAI3.6%date=2024-12-21 · command=aider --model gpt-4o-mini-2024-07-18 · dirname=2024-12-21-18-41-18--polyglot-gpt-4o-mini · versions=0.69.2.dev21 Dec 2024aider.chatT2 History

Scores are reported as published, with their evaluation configuration (harness, prompting, judge). The bar is relative to the best score on this page. Results with different configs are not directly comparable — see methodology.

The config filter matches a value inside each result's configuration (server-side, `config=` on the API). Chips are the values shared by several rows on the first page; per-model identifiers are not offered.