Updated 11 min ago · first seen 11 Sept 2026
- Metric
- accuracy · % ↑
- Current results
- 821
- Models
- 374
- Current leader
- gpt-5.6-sol 65.9%
Score history · minicpm5-1b-non-reasoning 1 row
Not enough history to chart — a single observation (0% on 11 Sept 2026). Rows under different configurations count separately; the list below shows each one.
- 0%aa_slug=minicpm5-1b-non-reasoning · variant=hard · evaluator=Artificial Analysis · index_version=4.311 Sept 2026
Frontier over time · accuracy · variant=hard · evaluator=Artificial Analysis
10 leader changes recorded, all dated 11 Sept 2026 — the frontier line needs at least two distinct dates. The corpus is young: every result was first observed on the same day, so leader changes will separate in time as sources are re-crawled.
- 65.9%gpt-5.6-sol OpenAI Independent11 Sept 2026
- 61.4%gpt-5.6-sol OpenAI Independent11 Sept 2026
- 53.0%Claude Sonnet 4.6 Anthropic Independent11 Sept 2026
- 51.5%Claude Opus 4.7 Anthropic Independent11 Sept 2026
- 50.8%Z.ai GLM 5.2 Z.ai (Zhipu AI) Independent11 Sept 2026
- 49.2%KAT-Coder-Pro V2 Kwaipilot Independent11 Sept 2026
- 33.3%GPT-5.1-Codex Mini OpenAI Independent11 Sept 2026
- 26.5%Grok 4.3 xAI Independent11 Sept 2026
Includes closed rows (history). A point is emitted whenever a result beats every earlier result of the same group, ordered by evaluated_at when the source publishes it, else observed_at.
Leaderboard 315 models
Select models with +, then Compare.
| # | Model | Score | Trust | Configuration | vs leader | Evaluated | Source | Actions |
|---|---|---|---|---|---|---|---|---|
| 1 | gpt-5.6-solClosedOpenAI · GPT 5.6 · best of 5 rows | 65.9% | Independent | group defaults | leader | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 2 | Claude Fable 5ClosedAnthropic · Claude | 62.9% | Independent | group defaults | Comparable-3.03 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 2 | gpt-5.6-terraClosedOpenAI · GPT 5.6 · best of 4 rows | 62.9% | Independent | reasoning_effortxhigh | Partially comparable-3.03 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 4 | gpt-5.5ClosedOpenAI · GPT 5.5 · best of 5 rows | 60.6% | Independent | group defaults | Comparable-5.30 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 5 | Claude Opus 4.8ClosedAnthropic · Claude | 58.3% | Independent | group defaults | Comparable-7.58 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 6 | gpt-5.4ClosedOpenAI · GPT 5.4 · best of 3 rows | 57.6% | Independent | group defaults | Comparable-8.33 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 7 | Claude Opus 4.7ClosedAnthropic · Claude · best of 2 rows | 54.5% | Independent | reasoningoff | Partially comparable-11.4 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 8 | Gemini 3.1 Pro PreviewClosedGoogle · Gemini | 53.8% | Independent | group defaults | Comparable-12.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 9 | Claude Sonnet 4.6ClosedAnthropic · Claude · best of 3 rows | 53.0% | Independent | reasoningadaptive | Partially comparable-12.9 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 9 | gpt-5.3-codexClosedOpenAI · GPT 5.3 | 53.0% | Independent | group defaults | Comparable-12.9 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 11 | gpt-5.4-miniClosedOpenAI · GPT 5.4 · best of 3 rows | 52.3% | Independent | group defaults | Comparable-13.6 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 12 | Qwen3.7 MaxClosedQwen · Qwen3.7 | 50.8% | Independent | group defaults | Comparable-15.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 12 | Z.ai GLM 5.2Open weightsZ.ai (Zhipu AI) · GLM5.2 | 50.8% | Independent | group defaults | Comparable-15.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 14 | KAT-Coder-Pro V2ClosedKwaipilot | 49.2% | Independent | group defaults | Comparable-16.7 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 15 | Claude Opus 4.6ClosedAnthropic · Claude · best of 2 rows | 48.5% | Independent | group defaults | Comparable-17.4 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 16 | Claude Opus 4.5ClosedAnthropic · Claude · best of 2 rows | 47.0% | Independent | reasoningon | Partially comparable-18.9 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 16 | Qwen 3.7 PlusClosedQwen · Qwen3.7 | 47.0% | Independent | group defaults | Comparable-18.9 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 16 | gpt-5.2ClosedOpenAI · GPT 5.2 · best of 3 rows | 47.0% | Independent | group defaults | Comparable-18.9 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 19 | Gemini 3.5 FlashClosedGoogle · Gemini · best of 3 rows | 46.2% | Independent | reasoning_effortminimal | Partially comparable-19.7 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 19 | deepseek-v4-pro-0424Open weightsDeepSeek · DeepSeek | 46.2% | Independent | group defaults | Comparable-19.7 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 21 | gpt-5.1ClosedOpenAI · GPT 5.1 · best of 2 rows | 45.5% | Independent | group defaults | Comparable-20.5 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 21 | muse-sparkClosedMeta AI | 45.5% | Independent | group defaults | Comparable-20.5 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 23 | Kimi K2.7 CodeOpen weightsMoonshot AI · Kimi | 44.7% | Independent | group defaults | Comparable-21.2 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 24 | Kimi K2.6Open weightsMoonshot AI · Kimi · best of 2 rows | 43.9% | Independent | group defaults | Comparable-22.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 24 | Qwen3.6 Max PreviewClosedQwen · Qwen3.6 | 43.9% | Independent | group defaults | Comparable-22.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 24 | Qwen3.6 PlusClosedQwen · Qwen3.6 | 43.9% | Independent | group defaults | Comparable-22.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 27 | GLM 5Open weightsZ.ai (Zhipu AI) · GLM5 · best of 2 rows | 43.2% | Independent | group defaults | Comparable-22.7 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 27 | GLM 5.1Open weightsZ.ai (Zhipu AI) · GLM5.1 · best of 2 rows | 43.2% | Independent | group defaults | Comparable-22.7 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 27 | MiMo-V2.5-ProOpen weightsXiaomi · best of 2 rows | 43.2% | Independent | group defaults | Comparable-22.7 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 30 | MiniMax-M3Open weightsMiniMax · MiniMax | 42.4% | Independent | group defaults | Comparable-23.5 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 30 | gpt-5-5-instant-05-26ClosedOpenAI · GPT 5.5 | 42.4% | Independent | group defaults | Comparable-23.5 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 30 | gpt-5.4-nanoClosedOpenAI · GPT 5.4 · best of 3 rows | 42.4% | Independent | group defaults | Comparable-23.5 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 33 | MiMo-V2.5Open weightsXiaomi | 41.7% | Independent | group defaults | Comparable-24.2 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 33 | deepseek-v4-pro-0424-highOpen weightsDeepSeek · DeepSeek | 41.7% | Independent | group defaults | Comparable-24.2 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 33 | gemini-3-proClosedGoogle · Gemini 3 · best of 2 rows | 41.7% | Independent | group defaults | Comparable-24.2 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 36 | Qwen3.5 397B A17BOpen weightsQwen · Qwen3.5 · best of 2 rows | 40.9% | Independent | group defaults | Comparable-25.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 36 | grok-4-20-0309ClosedSpaceXAI · Grok 4.20 · best of 2 rows | 40.9% | Independent | group defaults | Comparable-25.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 36 | mimo-v2-proClosedXiaomi | 40.9% | Independent | group defaults | Comparable-25.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 39 | MiniMax M2.7Open weightsMiniMax · MiniMax | 39.4% | Independent | group defaults | Comparable-26.5 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 40 | Gemini 3 Flash PreviewClosedGoogle · Gemini | 38.6% | Independent | group defaults | Comparable-27.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 40 | deepseek-v4-flash-0420-highOpen weightsDeepSeek · DeepSeek | 38.6% | Independent | group defaults | Comparable-27.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 42 | GPT-5-CodexClosedOpenAI · GPT 5 | 37.9% | Independent | group defaults | Comparable-28.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 42 | Grok 4.20ClosedxAI · Grok | 37.9% | Independent | group defaults | Comparable-28.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 42 | Grok 4.3ClosedxAI · Grok · best of 4 rows | 37.9% | Independent | group defaults | Comparable-28.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 42 | gpt-5ClosedOpenAI · GPT 5 · best of 4 rows | 37.9% | Independent | reasoning_effortmedium | Partially comparable-28.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 42 | grok-4ClosedSpaceXAI · Grok 4 | 37.9% | Independent | group defaults | Comparable-28.0 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 47 | GPT-5.2-CodexClosedOpenAI · GPT 5.2 | 37.1% | Independent | group defaults | Comparable-28.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 47 | o3ClosedOpenAI · OpenAI o-series | 37.1% | Independent | group defaults | Comparable-28.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 49 | Gemma 4 31BOpen weightsGoogle · Gemma 4 · best of 2 rows | 36.4% | Independent | group defaults | Comparable-29.5 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 49 | Nemotron 3 UltraOpen weightsNVIDIA · Nemotron 3 | 36.4% | Independent | group defaults | Comparable-29.5 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 49 | deepseek-v4-pro-0424-non-reasoningOpen weightsDeepSeek · DeepSeek | 36.4% | Independent | group defaults | Comparable-29.5 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 52 | Claude Sonnet 4.5ClosedAnthropic · Claude · best of 2 rows | 35.6% | Independent | reasoningon | Partially comparable-30.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 52 | DeepSeek V3.2Open weightsDeepSeek · DeepSeek-V3 | 35.6% | Independent | group defaults | Comparable-30.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 52 | Step 3.7 FlashOpen weightsStepFun · Step3.7 | 35.6% | Independent | group defaults | Comparable-30.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 52 | deepseek-v4-flash-0420Open weightsDeepSeek · DeepSeek | 35.6% | Independent | group defaults | Comparable-30.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 52 | mimo-v2-omni-0327ClosedXiaomi | 35.6% | Independent | group defaults | Comparable-30.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 57 | GPT-5.1-CodexClosedOpenAI · GPT 5.1 | 34.9% | Independent | group defaults | Comparable-31.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 57 | Kimi K2.5Open weightsMoonshot AI · Kimi · best of 2 rows | 34.9% | Independent | group defaults | Comparable-31.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 57 | MiniMax M2.5Open weightsMiniMax · MiniMax | 34.9% | Independent | group defaults | Comparable-31.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 57 | Qwen3.6 27BOpen weightsQwen · Qwen3.6 · best of 2 rows | 34.9% | Independent | group defaults | Comparable-31.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 57 | Qwen3.6 35B A3BOpen weightsQwen · Qwen3.6 · best of 2 rows | 34.9% | Independent | group defaults | Comparable-31.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 57 | deepseek-v3-2-specialeOpen weightsDeepSeek · DeepSeek | 34.9% | Independent | group defaults | Comparable-31.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 57 | mimo-v2-omniClosedXiaomi | 34.9% | Independent | group defaults | Comparable-31.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 64 | Claude Opus 4.1ClosedAnthropic · Claude | 34.3% | Independent | reasoningon | Partially comparable-31.6 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 65 | Hy3 previewOpen weightsTencent | 34.1% | Independent | group defaults | Comparable-31.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 65 | deepseek-v4-flash-0420-non-reasoningOpen weightsDeepSeek · DeepSeek | 34.1% | Independent | group defaults | Comparable-31.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 67 | GLM 5 TurboClosedZ.ai (Zhipu AI) · GLM5 | 33.3% | Independent | group defaults | Comparable-32.6 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 67 | GPT-5.1-Codex MiniClosedOpenAI · GPT 5.1 | 33.3% | Independent | group defaults | Comparable-32.6 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 67 | Mistral Medium 3.5Open weightsMistral AI · Mistral | 33.3% | Independent | group defaults | Comparable-32.6 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 67 | gpt-5-miniClosedOpenAI · GPT 5 · best of 3 rows | 33.3% | Independent | group defaults | Comparable-32.6 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 71 | DeepSeek V3Open weightsDeepSeek · DeepSeek · best of 2 rows | 32.6% | Independent | group defaults | Comparable-33.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 71 | GLM 5V TurboClosedZ.ai (Zhipu AI) · GLM5 | 32.6% | Independent | group defaults | Comparable-33.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 71 | Qwen3.5-27BOpen weightsQwen · Qwen3.5 · best of 2 rows | 32.6% | Independent | group defaults | Comparable-33.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 71 | Step 3.5 FlashOpen weightsStepFun · Step3.5 · best of 2 rows | 32.6% | Independent | group defaults | Comparable-33.3 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 75 | DeepSeek V3.1 TerminusOpen weightsDeepSeek · DeepSeek · best of 2 rows | 31.8% | Independent | group defaults | Comparable-34.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 75 | GLM 4.7Open weightsZ.ai (Zhipu AI) · GLM4.7 · best of 2 rows | 31.8% | Independent | group defaults | Comparable-34.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 75 | Hy3Open weightsTencent | 31.8% | Independent | reasoningoff | Partially comparable-34.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 75 | gemini-3-flashClosedGoogle · Gemini 3 | 31.8% | Independent | group defaults | Comparable-34.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 79 | Claude Opus 4ClosedAnthropic · Claude | 31.1% | Independent | group defaults | Comparable-34.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 79 | Claude Sonnet 4ClosedAnthropic · Claude · best of 2 rows | 31.1% | Independent | reasoningon | Partially comparable-34.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 79 | DeepSeek V3.2 ExpOpen weightsDeepSeek · DeepSeek-V3 | 31.1% | Independent | group defaults | Comparable-34.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 79 | Kimi K2 ThinkingOpen weightsMoonshot AI · Kimi | 31.1% | Independent | group defaults | Comparable-34.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 79 | North Mini Code (free)Open weightsCohere | 31.1% | Independent | group defaults | Comparable-34.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 79 | Qwen3.5-122B-A10BOpen weightsQwen · Qwen3.5 · best of 2 rows | 31.1% | Independent | group defaults | Comparable-34.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 79 | ling-2-6-1tOpen weightsinclusionAI | 31.1% | Independent | group defaults | Comparable-34.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 79 | mimo-v2-0206Open weightsXiaomi | 31.1% | Independent | group defaults | Comparable-34.8 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 87 | GLM 4.6Open weightsZ.ai (Zhipu AI) · GLM4.6 · best of 2 rows | 28.8% | Independent | group defaults | Comparable-37.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 87 | MiniMax M2.1Open weightsMiniMax · MiniMax | 28.8% | Independent | group defaults | Comparable-37.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 87 | Nemotron 3 SuperOpen weightsNVIDIA · Nemotron 3 | 28.8% | Independent | group defaults | Comparable-37.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 87 | jt-35b-flashClosedChina Mobile | 28.8% | Independent | group defaults | Comparable-37.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 87 | ring-2-6-1tOpen weightsinclusionAI | 28.8% | Independent | group defaults | Comparable-37.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 92 | mimo-v2-flashOpen weightsXiaomi · best of 2 rows | 28.0% | Independent | reasoningon | Partially comparable-37.9 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 93 | Claude Haiku 4.5ClosedAnthropic · Claude · best of 2 rows | 27.3% | Independent | group defaults | Comparable-38.6 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 94 | Gemini 2.5 ProClosedGoogle · Gemini | 26.5% | Independent | group defaults | Comparable-39.4 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 94 | Mercury 2ClosedInception | 26.5% | Independent | group defaults | Comparable-39.4 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 94 | Qwen3.5-35B-A3BOpen weightsQwen · Qwen3.5 · best of 2 rows | 26.5% | Independent | group defaults | Comparable-39.4 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 94 | doubao-seed-codeClosedByteDance · Seed | 26.5% | Independent | group defaults | Comparable-39.4 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 98 | MiniMax M2Open weightsMiniMax · MiniMax | 25.8% | Independent | group defaults | Comparable-40.1 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 99 | DeepSeek V3.1Open weightsDeepSeek · DeepSeek-V3 · best of 2 rows | 25% | Independent | reasoningon | Partially comparable-40.9 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
| 99 | Gemma 4 26B A4BOpen weightsGoogle · Gemma 4 · best of 2 rows | 25% | Independent | reasoningoff | Partially comparable-40.9 pt | obs. 11 Sept 2026 | artificialanalysis.aiT2 | History |
One row per canonical model — its best current row inside this comparability group (effort variants are folded into the model). Bars are relative to the page's best score. “vs leader” reads comparability: partially comparable = same task, conditions differ (reasoning effort, temperature, judge). Rules →