Skip to content
AI Atlas
BenchmarkActivecategory · coding

Aider polyglot

aider.chat/docs/leaderboards

225 Exercism exercises in 6 languages, edit-format aware

quality57

Updated 3 h ago · first seen 11 Sept 2026

bench_01M293SPEMVE6W55699099NES3

Metric
pass rate (2 attempts) · %
Direction
Higher is better
Results
138 · 30 filtered
Leader
QwQ-32B + Qwen 2.5 Coder Instruct 100%

Leaderboard 30 current results · config contains “whole”

Select models with +, then open Compare.

Leaderboard
#ModelScoreConfigEvaluatedSourceActions
1#1gemini-2.0-flash-expGoogle100%date=2024-12-22 · command=aider --model gemini/gemini-2.0-flash-exp · dirname=2024-12-22-20-08-13--gemini-2.0-flash-exp-polyglot-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
2#2Gemma 3 27BGoogle100%date=2025-03-15 · command=aider --model openrouter/google/gemma-3-27b-it · dirname=2025-03-15-01-21-24--gemma3-27b-or · versions=0.77.1.dev15 Mar 2025aider.chatT2 History
3#3Gemini 2.0 Pro exp-02-05100%date=2025-02-25 · command=aider --model gemini/gemini-2.0-pro-exp-02-05 · dirname=2025-02-25-20-23-07--gemini-pro · versions=0.75.2.dev25 Feb 2025aider.chatT2 History
4#4GPT-4o-mini (2024-07-18)OpenAI100%date=2024-12-21 · command=aider --model gpt-4o-mini-2024-07-18 · dirname=2024-12-21-18-41-18--polyglot-gpt-4o-mini · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
5#5Grok 3 Mini Beta (low)100%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-mini-beta · dirname=2025-04-10-18-47-24--grok3-mini-whole-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
6#6Codestral 25.01Mistral AI100%date=2025-01-13 · command=aider --model mistral/codestral-latest · dirname=2025-01-13-18-17-25--codestral-whole2 · versions=0.71.2.dev13 Jan 2025aider.chatT2 History
7#7Qwen2.5 Coder 32B InstructQwen99.6%date=2024-12-26 · command=aider --model openai/Qwen2.5-Coder-32B-Instruct · dirname=2024-12-26-00-55-20--Qwen2.5-Coder-32B-Instruct · versions=0.69.2.dev26 Dec 2024aider.chatT2 History
8#8Grok 3 Mini Beta (high)99.6%date=2025-04-10 · command=aider --model xai/grok-3-mini-beta --reasoning-effort high · dirname=2025-04-10-23-59-02--xai-grok3-mini-whole-high · versions=0.81.3.dev10 Apr 2025aider.chatT2 History
9#9command-a-03-2025-quality99.6%date=2025-03-14 · command=OPENAI_API_BASE=https://api.cohere.ai/compatibility/v1 aider --model openai/command-a-03-2025-quality · dirname=2025-03-14-23-40-00--cmda-quality-whole2 · versions=0.77.1.dev14 Mar 2025aider.chatT2 History
10#10Llama 4 MaverickMeta AI99.1%date=2025-04-06 · command=aider --model nvidia_nim/meta/llama-4-maverick-17b-128e-instruct · dirname=2025-04-06-08-39-52--llama-4-maverick-17b-128e-instruct-polyglot-whole · versions=0.81.2.dev6 Apr 2025aider.chatT2 History
11#11gemini-exp-120698.2%date=2024-12-22 · command=aider --model gemini/gemini-exp-1206 · dirname=2024-12-22-18-43-25--gemini-exp-1206-polyglot-whole-2 · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
12#12o1-mini-2024-09-1296.9%date=2024-12-22 · command=aider --model o1-mini · dirname=2024-12-22-21-26-35--polyglot-o1mini-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
13#13openhands-lm-32b-v0.195.1%date=2025-04-19 · command=aider --model openrouter/all-hands/openhands-lm-32b-v0.1 · dirname=2025-04-19-14-43-04--o4-mini-patch · versions=0.82.2.dev19 Apr 2025aider.chatT2 History
14#14gpt-4.1-nanoOpenAI94.2%date=2025-04-14 · command=aider --model gpt-4.1-nano · dirname=2025-04-14-22-46-01--gpt41nano-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
15#15yi-lightning92.9%date=2024-12-23 · command=aider --model openai/yi-lightning · dirname=2024-12-23-01-11-56--yi-test · versions=0.69.2.dev23 Dec 2024aider.chatT2 History
16#16Grok 3 Mini Beta (high)49.3%date=2025-04-10 · command=aider --model xai/grok-3-mini-beta --reasoning-effort high · dirname=2025-04-10-23-59-02--xai-grok3-mini-whole-high · versions=0.81.3.dev10 Apr 2025aider.chatT2 History
17#17gemini-exp-120638.2%date=2024-12-22 · command=aider --model gemini/gemini-exp-1206 · dirname=2024-12-22-18-43-25--gemini-exp-1206-polyglot-whole-2 · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
18#18Gemini 2.0 Pro exp-02-0535.6%date=2025-02-25 · command=aider --model gemini/gemini-2.0-pro-exp-02-05 · dirname=2025-02-25-20-23-07--gemini-pro · versions=0.75.2.dev25 Feb 2025aider.chatT2 History
19#19Grok 3 Mini Beta (low)34.7%date=2025-04-10 · command=aider --model openrouter/x-ai/grok-3-mini-beta · dirname=2025-04-10-18-47-24--grok3-mini-whole-exuser · versions=0.81.2.dev10 Apr 2025aider.chatT2 History
20#20o1-mini-2024-09-1232.9%date=2024-12-22 · command=aider --model o1-mini · dirname=2024-12-22-21-26-35--polyglot-o1mini-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
21#21gemini-2.0-flash-expGoogle22.2%date=2024-12-22 · command=aider --model gemini/gemini-2.0-flash-exp · dirname=2024-12-22-20-08-13--gemini-2.0-flash-exp-polyglot-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
22#22Qwen2.5 Coder 32B InstructQwen16.4%date=2024-12-26 · command=aider --model openai/Qwen2.5-Coder-32B-Instruct · dirname=2024-12-26-00-55-20--Qwen2.5-Coder-32B-Instruct · versions=0.69.2.dev26 Dec 2024aider.chatT2 History
23#23Llama 4 MaverickMeta AI15.6%date=2025-04-06 · command=aider --model nvidia_nim/meta/llama-4-maverick-17b-128e-instruct · dirname=2025-04-06-08-39-52--llama-4-maverick-17b-128e-instruct-polyglot-whole · versions=0.81.2.dev6 Apr 2025aider.chatT2 History
24#24yi-lightning12.9%date=2024-12-23 · command=aider --model openai/yi-lightning · dirname=2024-12-23-01-11-56--yi-test · versions=0.69.2.dev23 Dec 2024aider.chatT2 History
25#25command-a-03-2025-quality12%date=2025-03-14 · command=OPENAI_API_BASE=https://api.cohere.ai/compatibility/v1 aider --model openai/command-a-03-2025-quality · dirname=2025-03-14-23-40-00--cmda-quality-whole2 · versions=0.77.1.dev14 Mar 2025aider.chatT2 History
26#26Codestral 25.01Mistral AI11.1%date=2025-01-13 · command=aider --model mistral/codestral-latest · dirname=2025-01-13-18-17-25--codestral-whole2 · versions=0.71.2.dev13 Jan 2025aider.chatT2 History
27#27openhands-lm-32b-v0.110.2%date=2025-04-19 · command=aider --model openrouter/all-hands/openhands-lm-32b-v0.1 · dirname=2025-04-19-14-43-04--o4-mini-patch · versions=0.82.2.dev19 Apr 2025aider.chatT2 History
28#28gpt-4.1-nanoOpenAI8.9%date=2025-04-14 · command=aider --model gpt-4.1-nano · dirname=2025-04-14-22-46-01--gpt41nano-diff · versions=0.81.4.dev14 Apr 2025aider.chatT2 History
29#29Gemma 3 27BGoogle4.9%date=2025-03-15 · command=aider --model openrouter/google/gemma-3-27b-it · dirname=2025-03-15-01-21-24--gemma3-27b-or · versions=0.77.1.dev15 Mar 2025aider.chatT2 History
30#30GPT-4o-mini (2024-07-18)OpenAI3.6%date=2024-12-21 · command=aider --model gpt-4o-mini-2024-07-18 · dirname=2024-12-21-18-41-18--polyglot-gpt-4o-mini · versions=0.69.2.dev21 Dec 2024aider.chatT2 History

30 results

Scores are reported as published, with their evaluation configuration (harness, prompting, judge). The bar is relative to the best score on this page. Results with different configs are not directly comparable — see methodology.

The config filter matches a value inside each result's configuration (server-side, `config=` on the API). Chips are the values shared by several rows on the first page; per-model identifiers are not offered.