Skip to content
AI Atlas
BenchmarkActivecategory · coding

Aider polyglot

aider.chat/docs/leaderboards

225 Exercism exercises in 6 languages, edit-format aware

quality57

Updated 3 h ago · first seen 11 Sept 2026

bench_01M293SPEMVE6W55699099NES3

Metric
pass rate (2 attempts) · %
Direction
Higher is better
Results
138 · 12 filtered
Leader
QwQ-32B + Qwen 2.5 Coder Instruct 100%

Leaderboard 12 current results · config contains “0.83.3.dev”

Select models with +, then open Compare.

Leaderboard
#ModelScoreConfigEvaluatedSourceActions
1#1claude-opus-4-20250514 (no think)98.7%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-19-57-20--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
2#2claude-sonnet-4-20250514 (no thinking)98.2%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-21-17-54--sonnet4-diff-exuser · versions=0.83.3.dev24 May 2025aider.chatT2 History
3#3claude-opus-4-20250514 (32k thinking)97.3%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-20-40-51--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
4#4claude-sonnet-4-20250514 (32k thinking)97.3%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-22-10-36--sonnet4-diff-exuser-think32k · versions=0.83.3.dev24 May 2025aider.chatT2 History
5#5gemini-2.5-flash-preview-05-20 (24k think)95.6%date=2025-05-25 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-25-22-58-44--flash25-05-20-24k-think · versions=0.83.3.dev25 May 2025aider.chatT2 History
6#6gemini-2.5-flash-preview-05-20 (no think)93.8%date=2025-05-26 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-26-15-56-31--flash25-05-20-24k-think · versions=0.83.3.dev26 May 2025aider.chatT2 History
7#7claude-opus-4-20250514 (32k thinking)72%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-20-40-51--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
8#8claude-opus-4-20250514 (no think)70.7%date=2025-05-25 · command=aider --model claude-opus-4-20250514 · dirname=2025-05-25-19-57-20--opus4-diff-exuser · versions=0.83.3.dev25 May 2025aider.chatT2 History
9#9claude-sonnet-4-20250514 (32k thinking)61.3%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-22-10-36--sonnet4-diff-exuser-think32k · versions=0.83.3.dev24 May 2025aider.chatT2 History
10#10claude-sonnet-4-20250514 (no thinking)56.4%date=2025-05-24 · command=aider --model claude-sonnet-4-20250514 · dirname=2025-05-24-21-17-54--sonnet4-diff-exuser · versions=0.83.3.dev24 May 2025aider.chatT2 History
11#11gemini-2.5-flash-preview-05-20 (24k think)55.1%date=2025-05-25 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-25-22-58-44--flash25-05-20-24k-think · versions=0.83.3.dev25 May 2025aider.chatT2 History
12#12gemini-2.5-flash-preview-05-20 (no think)44%date=2025-05-26 · command=aider --model gemini/gemini-2.5-flash-preview-05-20 · dirname=2025-05-26-15-56-31--flash25-05-20-24k-think · versions=0.83.3.dev26 May 2025aider.chatT2 History

12 results

Scores are reported as published, with their evaluation configuration (harness, prompting, judge). The bar is relative to the best score on this page. Results with different configs are not directly comparable — see methodology.

The config filter matches a value inside each result's configuration (server-side, `config=` on the API). Chips are the values shared by several rows on the first page; per-model identifiers are not offered.