BenchmarkActivecategory · agentic
quality57
Updated 7 h ago · first seen 11 Sept 2026
bench_01M293SPFPKK4MF90JEDK0PH8C
- Metric
- accuracy · %
- Direction
- Higher is better
- Results
- 821 · 238 filtered
- Leader
- Claude Fable 5.1 91.39%
Score history · jt-35b-flash 1 row
Not enough history to chart — a single observation (28.79% on 11 Sept 2026). Rows under different configurations count separately; the list below shows each one.
- 28.79%aa_slug=jt-35b-flash · variant=hard · evaluator=Artificial Analysis · index_version=4.311 Sept 2026
Leaderboard 238 current results · config contains “v2.1”
Select models with +, then open Compare.
| # | Model | Score | Config | Evaluated | Source | Actions |
|---|---|---|---|---|---|---|
| #101Qwen3.6 27BQwen | 60.67% | aa_slug=qwen3-6-27b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #102gpt-5.4-nanoOpenAI | 60.67% | aa_slug=gpt-5-4-nano · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #103jt-4-1-flash-236b-a21bChina Mobile | 59.55% | aa_slug=jt-4-1-flash-236b-a21b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #104gpt-5.4-miniOpenAI | 59.18% | aa_slug=gpt-5-4-mini · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #105Solar Pro 4Upstage | 57.3% | aa_slug=solar-pro4 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #106deepseek-v4-flash-0420-highDeepSeek | 56.93% | aa_slug=deepseek-v4-flash-0420-high · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #107gpt-5-6-terra-non-reasoningOpenAI | 56.18% | aa_slug=gpt-5-6-terra-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #108claude-4-5-sonnet-thinkingAnthropic | 55.81% | aa_slug=claude-4-5-sonnet-thinking · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #109Ling 3.0 FlashinclusionAI | 55.43% | aa_slug=ling-3-0-flash · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #110MiniMax M2.7MiniMax | 55.43% | aa_slug=minimax-m2-7 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #111Inkling SmallThinking Machines | 55.06% | aa_slug=inkling-small · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #112InklingThinking Machines | 55.06% | aa_slug=inkling · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #113Nemotron 3 UltraNVIDIA | 53.93% | aa_slug=nvidia-nemotron-3-ultra-550b-a55b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #114Gemini 3.5 Flash-LiteGoogle | 53.56% | aa_slug=gemini-3-5-flash-lite · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #115gpt-5-6-luna-mediumOpenAI | 53.18% | aa_slug=gpt-5-6-luna-medium · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #116gpt-5.1OpenAI | 52.43% | aa_slug=gpt-5-1 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #117grok-build-0-1-06-16SpaceXAI | 52.06% | aa_slug=grok-build-0-1-06-16 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #118glm-5-2-non-reasoningZ.ai (Zhipu AI) | 51.69% | aa_slug=glm-5-2-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #119Muse Glimmer 30BMeta AI | 51.69% | aa_slug=muse-glimmer · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #120qwen3-6-27b-non-reasoningAlibaba Group | 51.31% | aa_slug=qwen3-6-27b-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #121Qwen3.5 397B A17BQwen | 51.31% | aa_slug=qwen3-5-397b-a17b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #122Mistral Medium 3.5Mistral AI | 50.56% | aa_slug=mistral-medium-3-5 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #123LongCat 2.0Meituan | 50.19% | aa_slug=longcat-2-0 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #124glm-4-6-reasoningZ.ai (Zhipu AI) | 49.44% | aa_slug=glm-4-6-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #125qwen3-8-27b-non-reasoningAlibaba Group | 49.06% | aa_slug=qwen3-8-27b-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #126Qwen3.5-122B-A10BQwen | 47.57% | aa_slug=qwen3-5-122b-a10b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #127qwen3-5-122b-a10b-non-reasoningAlibaba Group | 47.19% | aa_slug=qwen3-5-122b-a10b-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #128DeepSeek V3.2DeepSeek | 46.82% | aa_slug=deepseek-v3-2-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #129Kimi K2.5Moonshot AI | 45.69% | aa_slug=kimi-k2-5 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #130GLM 4.7Z.ai (Zhipu AI) | 45.32% | aa_slug=glm-4-7 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #131Qwen3.6 35B A3BQwen | 44.94% | aa_slug=qwen3-6-35b-a3b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #132deepseek-v3-1-terminus-reasoningDeepSeek | 44.94% | aa_slug=deepseek-v3-1-terminus-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #133solar-open2-250bUpstage | 44.19% | aa_slug=solar-open2-250b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #134claude-4-5-haiku-reasoningAnthropic | 44.19% | aa_slug=claude-4-5-haiku-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #135gpt-5-6-luna-lowOpenAI | 43.45% | aa_slug=gpt-5-6-luna-low · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #136Gemma 4 31BGoogle | 43.45% | aa_slug=gemma-4-31b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #137ring-2-6-1tinclusionAI | 43.07% | aa_slug=ring-2-6-1t · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #138qwen3-6-35b-a3b-non-reasoningAlibaba Group | 41.57% | aa_slug=qwen3-6-35b-a3b-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #139qwen3-5-35b-a3b-non-reasoningAlibaba Group | 40.82% | aa_slug=qwen3-5-35b-a3b-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #140k-exaone-2-0-0803LG AI Research | 40.45% | aa_slug=k-exaone-2-0-0803 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #141Grok 4.3xAI | 39.7% | aa_slug=grok-4-3 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #142Step 3.7 FlashStepFun | 39.33% | aa_slug=step-3-7-flash · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #143gpt-5-6-luna-non-reasoningOpenAI | 38.95% | aa_slug=gpt-5-6-luna-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #144Gemma 4 26B A4BGoogle | 38.95% | aa_slug=gemma-4-26b-a4b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #145a-x-k2SK Telecom | 38.95% | aa_slug=a-x-k2 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #146Nemotron 3 SuperNVIDIA | 38.58% | aa_slug=nvidia-nemotron-3-super-120b-a12b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #147Qwen3 Coder NextQwen | 38.2% | aa_slug=qwen3-coder-next · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #148claude-4-sonnet-thinkingAnthropic | 36.33% | aa_slug=claude-4-sonnet-thinking · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #149North Mini Code (free)Cohere | 35.58% | aa_slug=north-mini-code · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #150gpt-5OpenAI | 35.21% | aa_slug=gpt-5 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #151gpt-5-5-instant-06-26OpenAI | 34.83% | aa_slug=gpt-5-5-instant-06-26 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #152grok-4-3-non-reasoningSpaceXAI | 34.08% | aa_slug=grok-4-3-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #153g9v3-39a5bAI9Stars | 32.58% | aa_slug=g9v3-39a5b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #154gemini-3-1-flash-lite-previewGoogle | 31.09% | aa_slug=gemini-3-1-flash-lite-preview · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #155k-exaoneLG AI Research | 30.34% | aa_slug=k-exaone · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #156Devstral 2Mistral AI | 30.34% | aa_slug=devstral-2 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #157Devstral Small 2Mistral AI | 29.59% | aa_slug=devstral-small-2 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #158nova-2-0-pro-reasoning-mediumAmazon Web Services | 29.59% | aa_slug=nova-2-0-pro-reasoning-medium · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #159Qwen3.5-9BQwen | 29.21% | aa_slug=qwen3-5-9b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #160gemma-4-31b-non-reasoningGoogle | 29.21% | aa_slug=gemma-4-31b-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #161Gemini 2.5 ProGoogle | 28.46% | aa_slug=gemini-2-5-pro · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #162ling-3-0-tinyinclusionAI | 27.72% | aa_slug=ling-3-0-tiny · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #163gemma-4-12BGoogle | 27.34% | aa_slug=gemma-4-12b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #164Mercury 2Inception | 27.34% | aa_slug=mercury-2 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #165granite-4.2-30bIBM | 26.59% | aa_slug=granite-4-2-30b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #166Mistral Small 3.1Mistral AI | 26.22% | aa_slug=mistral-small-3-1 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #167gpt-oss-120bOpenAI | 26.22% | aa_slug=gpt-oss-120b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #168Qwen3.5-4BQwen | 25.84% | aa_slug=qwen3-5-4b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #169Nemotron 3.5 LightningNVIDIA | 24.34% | aa_slug=nemotron-3-5-lightning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #170ling-2-6-flashinclusionAI | 24.34% | aa_slug=ling-2-6-flash · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #171command-a-plusCohere | 22.85% | aa_slug=command-a-plus · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #172qwen3-5-9b-non-reasoningAlibaba Group | 21.35% | aa_slug=qwen3-5-9b-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #173qwen3-5-4b-non-reasoningAlibaba Group | 21.35% | aa_slug=qwen3-5-4b-non-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #174exaone-4-5-33bLG AI Research | 21.35% | aa_slug=exaone-4-5-33b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #175Mistral Small 4Mistral AI | 20.97% | aa_slug=mistral-small-4 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #176Trinity Large ThinkingArcee AI | 20.6% | aa_slug=trinity-large-thinking · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #177nemotron-cascade-2-30b-a3bNVIDIA | 20.6% | aa_slug=nemotron-cascade-2-30b-a3b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #178nova-2-0-pro-reasoning-lowAmazon Web Services | 19.48% | aa_slug=nova-2-0-pro-reasoning-low · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #179deepseek-r1-0120DeepSeek | 19.1% | aa_slug=deepseek-r1-0120 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #180Granite 4.2 8BIBM | 18.35% | aa_slug=granite-4-2-8b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #181hypernova-60bMultiverse Computing | 18.35% | aa_slug=hypernova-60b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #182nova-2-0-proAmazon Web Services | 17.23% | aa_slug=nova-2-0-pro · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #183deepseek-v3DeepSeek | 16.85% | aa_slug=deepseek-v3 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #184nova-2-0-lite-reasoningAmazon Web Services | 16.1% | aa_slug=nova-2-0-lite-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #185k2-think-v2MBZUAI Institute of Foundation Models | 14.98% | aa_slug=k2-think-v2 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #186Mistral Medium 3.1Mistral AI | 13.86% | aa_slug=mistral-medium-3-1 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #187DeepSeek V3 0324DeepSeek | 13.86% | aa_slug=deepseek-v3-0324 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #188granite-4.2-3bIBM | 13.86% | aa_slug=granite-4-2-3b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #189gpt-oss-20bOpenAI | 13.86% | aa_slug=gpt-oss-20b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #190gpt-oss-120b-lowOpenAI | 13.86% | aa_slug=gpt-oss-120b-low · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #191diffusiongemma-26b-a4bGoogle | 12.36% | aa_slug=diffusiongemma-26b-a4b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #192Magistral Medium 1.2Mistral AI | 12.36% | aa_slug=magistral-medium-2509 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #193Solar Pro 3Upstage | 11.99% | aa_slug=solar-pro-3 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #194Qwen3 235B A22B Instruct 2507Qwen | 11.99% | aa_slug=qwen3-235b-a22b-instruct-2507-reasoning · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #195Mistral Large 3Mistral AI | 11.99% | aa_slug=mistral-large-3 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #196celeris-1Celeris | 11.24% | aa_slug=celeris-1 · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #197Claude Haiku 3.5Anthropic | 10.11% | aa_slug=claude-3-5-haiku · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #198gpt-4.1-miniOpenAI | 10.11% | aa_slug=gpt-4-1-mini · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #199Ministral 3 14BMistral AI | 9.74% | aa_slug=ministral-3-14b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History | |
| #200minicpm5-2bOpenBMB | 8.61% | aa_slug=minicpm5-2b · variant=v2.1 · evaluator=Artificial Analysis · index_version=4.3 | — (obs. 11 Sept 2026) | artificialanalysis.aiT2 | History |
Scores are reported as published, with their evaluation configuration (harness, prompting, judge). The bar is relative to the best score on this page. Results with different configs are not directly comparable — see methodology.
The config filter matches a value inside each result's configuration (server-side, `config=` on the API). Chips are the values shared by several rows on the first page; per-model identifiers are not offered.
Definition
- Category
- agentic
Source:AI Atlas curated registry (YAML, versioned in git, every entry carries its source URL)T2observed 7 h agomedium
- Task
- terminal tasks solved by agents
Source:AI Atlas curated registry (YAML, versioned in git, every entry carries its source URL)T2observed 7 h agomedium
- Metric
- accuracy · %
Source:AI Atlas curated registry (YAML, versioned in git, every entry carries its source URL)T2observed 7 h agomedium
- Direction
- Higher is better
- Website
Source:AI Atlas curated registry (YAML, versioned in git, every entry carries its source URL)T2observed 7 h agomedium
Each value shows its source, tier and observation time. Missing rows mean no source stated them. How results are recorded →
- Evaluated models
- grok-3-mini-reasoning, claude-opus-5-medium, gemma-4-12B, deepseek-v4-flash, grok-4-3-low, GPT-5.1-Codex Mini, Qwen3 Coder Next, KAT-Coder-Pro V2 +523(531 total)
As of
Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.
Claim history
5 claims · 5 properties
Categorycategory1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| agentic | → current | current | AI Atlas curated registry (YAML, versioned in git, every entry carries its source URL)T2 | medium | curated |
Metricmetric1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| accuracy | → current | current | AI Atlas curated registry (YAML, versioned in git, every entry carries its source URL)T2 | medium | curated |
Tasktask1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| terminal tasks solved by agents | → current | current | AI Atlas curated registry (YAML, versioned in git, every entry carries its source URL)T2 | medium | curated |
Unitunit1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| % | → current | current | AI Atlas curated registry (YAML, versioned in git, every entry carries its source URL)T2 | medium | curated |
Websitewebsite1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| https://www.tbench.ai | → current | current | AI Atlas curated registry (YAML, versioned in git, every entry carries its source URL)T2 | medium | curated |
Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →
| Source | Document | Type | Tier | Last observed | Snapshots |
|---|---|---|---|---|---|
| Artificial Analysis | artificialanalysis.ai/leaderboards/models | leaderboard | T2· Quality secondary | 5 h ago | 1 |
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.