Skip to content
AI Atlas
BenchmarkActivecategory · coding

Aider polyglot

aider.chat/docs/leaderboards

225 Exercism exercises in 6 languages, edit-format aware

quality57

Updated 3 h ago · first seen 11 Sept 2026

bench_01M293SPEMVE6W55699099NES3

Metric
pass rate (2 attempts) · %
Direction
Higher is better
Results
138 · 22 filtered
Leader
QwQ-32B + Qwen 2.5 Coder Instruct 100%

Leaderboard 22 current results · config contains “0.69.2.dev”

Select models with +, then open Compare.

Leaderboard
#ModelScoreConfigEvaluatedSourceActions
1#1GPT-4o-mini (2024-07-18)OpenAI100%date=2024-12-21 · command=aider --model gpt-4o-mini-2024-07-18 · dirname=2024-12-21-18-41-18--polyglot-gpt-4o-mini · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
2#2gemini-2.0-flash-expGoogle100%date=2024-12-22 · command=aider --model gemini/gemini-2.0-flash-exp · dirname=2024-12-22-20-08-13--gemini-2.0-flash-exp-polyglot-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
3#3Qwen2.5 Coder 32B InstructQwen99.6%date=2024-12-26 · command=aider --model openai/Qwen2.5-Coder-32B-Instruct · dirname=2024-12-26-00-55-20--Qwen2.5-Coder-32B-Instruct · versions=0.69.2.dev26 Dec 2024aider.chatT2 History
4#4DeepSeek Chat V3 (prev)98.7%date=2024-12-25 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-25-13-31-51--deepseekv3preview-diff2 · versions=0.69.2.dev25 Dec 2024aider.chatT2 History
5#5gemini-exp-120698.2%date=2024-12-22 · command=aider --model gemini/gemini-exp-1206 · dirname=2024-12-22-18-43-25--gemini-exp-1206-polyglot-whole-2 · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
6#6o1-mini-2024-09-1296.9%date=2024-12-22 · command=aider --model o1-mini · dirname=2024-12-22-21-26-35--polyglot-o1mini-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
7#7DeepSeek Chat V2.592.9%date=2024-12-21 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-21-20-56-21--polyglot-deepseek-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
8#8yi-lightning92.9%date=2024-12-23 · command=aider --model openai/yi-lightning · dirname=2024-12-23-01-11-56--yi-test · versions=0.69.2.dev23 Dec 2024aider.chatT2 History
9#9o1-2024-12-17 (high)91.5%date=2024-12-21 · command=aider --model openrouter/openai/o1 · dirname=2024-12-21-19-23-03--polyglot-o1-hard-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
10#10Claude Haiku 3.5Anthropic91.1%date=2024-12-21 · command=aider --model claude-3-5-haiku-20241022 · dirname=2024-12-21-21-46-27--polyglot-haiku-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
11#11Qwen2.5 Coder 32B InstructQwen71.6%date=2024-12-22 · command=aider --model openai/Qwen/Qwen2.5-Coder-32B-Instruct # via hyperbolic · dirname=2024-12-22-13-22-32--polyglot-qwen-diff · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
12#12o1-2024-12-17 (high)61.7%date=2024-12-21 · command=aider --model openrouter/openai/o1 · dirname=2024-12-21-19-23-03--polyglot-o1-hard-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
13#13DeepSeek Chat V3 (prev)48.4%date=2024-12-25 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-25-13-31-51--deepseekv3preview-diff2 · versions=0.69.2.dev25 Dec 2024aider.chatT2 History
14#14gemini-exp-120638.2%date=2024-12-22 · command=aider --model gemini/gemini-exp-1206 · dirname=2024-12-22-18-43-25--gemini-exp-1206-polyglot-whole-2 · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
15#15o1-mini-2024-09-1232.9%date=2024-12-22 · command=aider --model o1-mini · dirname=2024-12-22-21-26-35--polyglot-o1mini-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
16#16Claude Haiku 3.5Anthropic28%date=2024-12-21 · command=aider --model claude-3-5-haiku-20241022 · dirname=2024-12-21-21-46-27--polyglot-haiku-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
17#17gemini-2.0-flash-expGoogle22.2%date=2024-12-22 · command=aider --model gemini/gemini-2.0-flash-exp · dirname=2024-12-22-20-08-13--gemini-2.0-flash-exp-polyglot-whole · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
18#18DeepSeek Chat V2.517.8%date=2024-12-21 · command=aider --model deepseek/deepseek-chat · dirname=2024-12-21-20-56-21--polyglot-deepseek-diff · versions=0.69.2.dev21 Dec 2024aider.chatT2 History
19#19Qwen2.5 Coder 32B InstructQwen16.4%date=2024-12-26 · command=aider --model openai/Qwen2.5-Coder-32B-Instruct · dirname=2024-12-26-00-55-20--Qwen2.5-Coder-32B-Instruct · versions=0.69.2.dev26 Dec 2024aider.chatT2 History
20#20yi-lightning12.9%date=2024-12-23 · command=aider --model openai/yi-lightning · dirname=2024-12-23-01-11-56--yi-test · versions=0.69.2.dev23 Dec 2024aider.chatT2 History
21#21Qwen2.5 Coder 32B InstructQwen8%date=2024-12-22 · command=aider --model openai/Qwen/Qwen2.5-Coder-32B-Instruct # via hyperbolic · dirname=2024-12-22-13-22-32--polyglot-qwen-diff · versions=0.69.2.dev22 Dec 2024aider.chatT2 History
22#22GPT-4o-mini (2024-07-18)OpenAI3.6%date=2024-12-21 · command=aider --model gpt-4o-mini-2024-07-18 · dirname=2024-12-21-18-41-18--polyglot-gpt-4o-mini · versions=0.69.2.dev21 Dec 2024aider.chatT2 History

22 results

Scores are reported as published, with their evaluation configuration (harness, prompting, judge). The bar is relative to the best score on this page. Results with different configs are not directly comparable — see methodology.

The config filter matches a value inside each result's configuration (server-side, `config=` on the API). Chips are the values shared by several rows on the first page; per-model identifiers are not offered.