Skip to content
AI Atlas
BenchmarkActivecategory · coding

Aider polyglot

aider.chat/docs/leaderboards

225 Exercism exercises in 6 languages, edit-format aware

quality57

Updated 6 h ago · first seen 11 Sept 2026

bench_01M293SPEMVE6W55699099NES3

Metric
pass rate (2 attempts) · %
Direction
Higher is better
Results
138 · 126 filtered
Leader
QwQ-32B + Qwen 2.5 Coder Instruct 100%

Score history · Claude Haiku 3.5 2 rows

Not enough history to chart — 2 observations, all dated 21 Dec 2024. Rows under different configurations count separately; the list below shows each one.

  • 91.1%date=2024-12-21 · command=aider --model claude-3-5-haiku-20241022 · dirname=2024-12-21-21-46-27--polyglot-haiku-diff · versions=0.69.2.dev21 Dec 2024
  • 28%date=2024-12-21 · command=aider --model claude-3-5-haiku-20241022 · dirname=2024-12-21-21-46-27--polyglot-haiku-diff · versions=0.69.2.dev21 Dec 2024

Back to the full leaderboard

Leaderboard 126 current results · config contains “225”

Select models with +, then open Compare.

Leaderboard
#ModelScoreConfigEvaluatedSourceActions
101#101gpt-oss-120b (high)41.8%date=2025-08-06 · command=aider --model openrouter/openai/gpt-oss-120b --reasoning-effort high · dirname=2025-08-06-04-54-48--gpt-oss-120b-high-polyglot · versions=0.85.3.dev6 Aug 2025aider.chatT2 History
102#102Qwen3 32BQwen40%date=2025-05-08 · command=aider --model openrouter/qwen/qwen3-32b · dirname=2025-05-08-03-20-24--qwen3-32b-default · versions=0.82.4.dev8 May 2025aider.chatT2 History
103#103gemini-exp-120638.2%date=2024-12-22 · command=aider --model gemini/gemini-exp-1206 · dirname=2024-12-22-18-43-25--gemini-exp-1206-polyglot-whole-2 · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
104#104Gemini 2.0 Pro exp-02-0535.6%date=2025-02-25 · command=aider --model gemini/gemini-2.0-pro-exp-02-05 · dirname=2025-02-25-20-23-07--gemini-pro · versions=0.75.2.dev25 Feb 2025aider.chatT2 History
105#105Grok 3 Mini Beta (low)34.7%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-mini-beta · dirname=2025-04-10-18-47-24--grok3-mini-whole-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
106#106o1-mini-2024-09-1232.9%date=2024-12-22 · command=aider --model o1-mini · dirname=2024-12-22-21-26-35--polyglot-o1mini-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
107#107gpt-4.1-miniOpenAI32.4%date=2025-04-14 · command=aider --model gpt-4.1-mini · dirname=2025-04-14-21-27-53--gpt41mini-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
108#108Claude Haiku 3.5Anthropic28%date=2024-12-21 · command=aider --model claude-3-5-haiku-20241022 · dirname=2024-12-21-21-46-27--polyglot-haiku-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
109#109QwQ-32B + Qwen 2.5 Coder Instruct26.2%date=2025-03-07 · command=aider --model fireworks_ai/accounts/fireworks/models/qwq-32b --architect · dirname=2025-03-07-15-11-27--qwq32b-arch-temp-topp-again · versions=0.75.3.dev7 Mar 2025aider.chatT2 History
110#110GPT-4o (2024-08-06)OpenAI23.1%date=2024-12-30 · command=aider --model gpt-4o-2024-08-06 · dirname=2024-12-30-20-44-54--gpt4o-ex-as-sys-clean-prompt · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
111#111gemini-2.0-flash-expGoogle22.2%date=2024-12-22 · command=aider --model gemini/gemini-2.0-flash-exp · dirname=2024-12-22-20-08-13--gemini-2.0-flash-exp-polyglot-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
112#112qwen-max-2025-01-2521.8%date=2025-01-28 · command=OPENAI_API_BASE=https://dashscope-intl.aliyuncs.com/compatible-mode/v1 aider --model openai/qwen-max-2025-01-25 · dirname=2025-01-28-16-00-03--qwen-max-2025-01-25-polyglot-diff · versions=0.72.4.dev28 Jan 2025aider.chatT2 History
113#113QwQ-32BAlibaba Group20.9%date=2025-03-06 · command=aider --model fireworks_ai/accounts/fireworks/models/qwq-32b · dirname=2025-03-06-17-40-24--qwq32b-diff-temp-topp-ex-sys-remind-user-for-real · versions=0.75.3.dev6 Mar 2025aider.chatT2 History
114#114GPT-4o (2024-11-20)OpenAI18.2%date=2024-12-30 · command=aider --model gpt-4o-2024-11-20 · dirname=2024-12-30-20-57-12--gpt-4o-2024-11-20-ex-as-sys · versions=0.70.1.dev30 Dec 2024aider.chatT2 History
115#115gemini-2.0-flash-thinking-exp-01-21Google18.2%date=2025-01-21 · command=aider --model gemini/gemini-2.0-flash-thinking-exp-01-21 · dirname=2025-01-21-22-51-49--gemini-2.0-flash-thinking-exp-01-21-polyglot-diff · versions=0.72.2.dev21 Jan 2025aider.chatT2 History
116#116DeepSeek Chat V2.517.8%date=2024-12-21 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-21-20-56-21--polyglot-deepseek-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
117#117Qwen2.5 Coder 32B InstructQwen16.4%date=2024-12-26 · command=aider --model openai/Qwen2.5-Coder-32B-Instruct · dirname=2024-12-26-00-55-20--Qwen2.5-Coder-32B-Instruct · versions=0.69.2.dev26 Dec 2024aider.chatT2 History
118#118Llama 4 MaverickMeta AI15.6%date=2025-04-06 · command=aider --model nvidia_nim/meta/llama-4-maverick-17b-128e-instruct · dirname=2025-04-06-08-39-52--llama-4-maverick-17b-128e-instruct-polyglot-whole · versions=0.81.2.dev6 Apr 2025aider.chatT2 History
119#119yi-lightning12.9%date=2024-12-23 · command=aider --model openai/yi-lightning · dirname=2024-12-23-01-11-56--yi-test · versions=0.69.2.dev23 Dec 2024aider.chatT2 History
120#120command-a-03-2025-quality12%date=2025-03-14 · command=OPENAI_API_BASE=https://api.cohere.ai/compatibility/v1 aider --model openai/command-a-03-2025-quality · dirname=2025-03-14-23-40-00--cmda-quality-whole2 · versions=0.77.1.dev14 Mar 2025aider.chatT2 History
121#121Codestral 25.01Mistral AI11.1%date=2025-01-13 · command=aider --model mistral/codestral-latest · dirname=2025-01-13-18-17-25--codestral-whole2 · versions=0.71.2.dev13 Jan 2025aider.chatT2 History
122#122openhands-lm-32b-v0.110.2%date=2025-04-19 · command=aider --model openrouter/all-hands/openhands-lm-32b-v0.1 · dirname=2025-04-19-14-43-04--o4-mini-patch · versions=0.82.2.dev19 Apr 2025aider.chatT2 History
123#123gpt-4.1-nanoOpenAI8.9%date=2025-04-14 · command=aider --model gpt-4.1-nano · dirname=2025-04-14-22-46-01--gpt41nano-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
124#124Qwen2.5 Coder 32B InstructQwen8%date=2024-12-22 · command=aider --model openai/Qwen/Qwen2.5-Coder-32B-Instruct # via hyperbolic · dirname=2024-12-22-13-22-32--polyglot-qwen-diff · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
125#125Gemma 3 27BGoogle4.9%date=2025-03-15 · command=aider --model openrouter/google/gemma-3-27b-it · dirname=2025-03-15-01-21-24--gemma3-27b-or · versions=0.77.1.dev15 Mar 2025aider.chatT2 History
126#126GPT-4o-mini (2024-07-18)OpenAI3.6%date=2024-12-21 · command=aider --model gpt-4o-mini-2024-07-18 · dirname=2024-12-21-18-41-18--polyglot-gpt-4o-mini · versions=0.69.2.dev21 Dec 2024aider.chatT2 History

Scores are reported as published, with their evaluation configuration (harness, prompting, judge). The bar is relative to the best score on this page. Results with different configs are not directly comparable — see methodology.

The config filter matches a value inside each result's configuration (server-side, `config=` on the API). Chips are the values shared by several rows on the first page; per-model identifiers are not offered.