198 devstral-small Open weights Mistral AI · Devstral · best of 2 rows 6.06% Independent reasoning off Partially comparable 0.00 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 198 ernie-4-5-300b-a47b Open weights Baidu · ERNIE 4.5 · best of 2 rows 6.06% Independent reasoning off Partially comparable 0.00 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 198 mistral-large-2 Open weights Mistral AI · Mistral · best of 2 rows 6.06% Independent reasoning off Partially comparable 0.00 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 198 nova-pro Closed Amazon Web Services · Nova · best of 2 rows 6.06% Independent reasoning off Partially comparable 0.00 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 198 qwen3-235b-a22b-instruct Open weights Alibaba Group · Qwen3 · best of 4 rows 6.06% Independent reasoning on Partially comparable 0.00 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 198 qwen3-30b-a3b-2507 Open weights Alibaba Group · Qwen3 · best of 4 rows 6.06% Independent reasoning off Partially comparable 0.00 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 207 llama-nemotron-super-49b-v1-5 Open weights NVIDIA · Llama · best of 4 rows 5.30% Independent reasoning on Partially comparable -0.76 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 207 qwen3-14b-instruct Open weights Alibaba Group · Qwen3 · best of 3 rows 5.30% Independent reasoning off Partially comparable -0.76 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 207 step-3-vl-10b Open weights StepFun · Step3 · best of 2 rows 5.30% Independent reasoning on Partially comparable -0.76 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 Hermes-4-70B Restricted weights Nous Research · Hermes 4 4.55% Independent group defaults Partially comparable -1.51 pt obs. 11 Sept 2026 artificialanalysis.ai T2 History 210 LFM2.5-8B-A1B Open weights Liquid AI · LFM2.5 · best of 2 rows 4.55% Independent reasoning on Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 Magistral Small 1.2 Open weights Mistral AI · Magistral · best of 2 rows 4.55% Independent reasoning on Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 Ministral 3 14B Open weights Mistral AI · Ministral 3 · best of 2 rows 4.55% Independent reasoning off Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 Ministral 3 8B Open weights Mistral AI · Ministral 3 · best of 2 rows 4.55% Independent reasoning off Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 Qwen2.5 72B Instruct Open weights Qwen · Qwen2.5 · best of 2 rows 4.55% Independent reasoning off Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 hermes-4-llama-3-1-70b Open weights Nous Research · Llama 3.1 · best of 3 rows 4.55% Independent reasoning on Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 llama-3-1-nemotron-instruct-70b Open weights NVIDIA · Llama 3.1 · best of 2 rows 4.55% Independent reasoning off Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 magistral-small Open weights Mistral AI · Magistral · best of 2 rows 4.55% Independent reasoning on Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 nvidia-nemotron-nano-12b-v2-vl Open weights NVIDIA · Nemotron · best of 4 rows 4.55% Independent reasoning on Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 qwen3-4b-2507-instruct Open weights Alibaba Group · Qwen3 · best of 4 rows 4.55% Independent reasoning off Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 210 solar-pro-2 Closed Upstage · Solar · best of 4 rows 4.55% Independent reasoning off Partially comparable -1.51 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 222 Gemini 2.0 Flash Closed Google · Gemini 2.0 · best of 2 rows 3.79% Independent reasoning off Partially comparable -2.27 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 222 Gemma 3 27B Open weights Google · Gemma 3 · best of 2 rows 3.79% Independent reasoning off Partially comparable -2.27 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 222 Mistral Medium 3 Closed Mistral AI · Mistral · best of 2 rows 3.79% Independent reasoning off Partially comparable -2.27 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 222 Phi 4 Open weights Microsoft · Phi4 · best of 2 rows 3.79% Independent reasoning off Partially comparable -2.27 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 222 Qwen3 14B Open weights Qwen · Qwen3 3.79% Independent group defaults Partially comparable -2.27 pt obs. 11 Sept 2026 artificialanalysis.ai T2 History 222 Qwen3 VL 8B Instruct Open weights Qwen · Qwen3 · best of 4 rows 3.79% Independent reasoning on Partially comparable -2.27 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 222 Qwen3.5-2B Open weights Qwen · Qwen3.5 · best of 4 rows 3.79% Independent reasoning off Partially comparable -2.27 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 222 exaone-4-0-32b Open weights LG AI Research · EXAONE 4.0 · best of 4 rows 3.79% Independent reasoning on Partially comparable -2.27 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 222 gpt-4.1-nano Closed OpenAI · GPT 4.1 · best of 2 rows 3.79% Independent reasoning off Partially comparable -2.27 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 222 motif-2-12-7b Closed Motif Technologies · best of 2 rows 3.79% Independent reasoning on Partially comparable -2.27 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 222 qwen3-omni-30b-a3b-instruct Open weights Alibaba Group · Qwen3 · best of 4 rows 3.79% Independent reasoning on Partially comparable -2.27 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 233 Llama 3.3 70B Open weights Meta AI · Llama 3.3 · best of 2 rows 3.03% Independent reasoning off Partially comparable -3.03 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 233 Llama-3.1-70B Open weights Meta AI · Llama 3.1 · best of 2 rows 3.03% Independent reasoning off Partially comparable -3.03 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 233 MiniMax-M1-80k Open weights MiniMax · MiniMax · best of 2 rows 3.03% Independent reasoning on Partially comparable -3.03 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 233 Qwen3 32B Open weights Qwen · Qwen3 3.03% Independent group defaults Partially comparable -3.03 pt obs. 11 Sept 2026 artificialanalysis.ai T2 History 233 gemma-4-E2B Open weights Google · Gemma 4 · best of 4 rows 3.03% Independent reasoning on Partially comparable -3.03 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 233 midm-250-pro-rsnsft Closed Korea Telecom · best of 2 rows 3.03% Independent reasoning on Partially comparable -3.03 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 233 qwen3-32b-instruct Open weights Alibaba Group · Qwen3 3.03% Independent reasoning on Partially comparable -3.03 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 Claude Haiku 3.5 Closed Anthropic · Claude · best of 2 rows 2.27% Independent reasoning off Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 MiniMax-M1-40k Open weights MiniMax · MiniMax · best of 2 rows 2.27% Independent reasoning on Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 Qwen3 8B Open weights Qwen · Qwen3 2.27% Independent group defaults Partially comparable -3.79 pt obs. 11 Sept 2026 artificialanalysis.ai T2 History 240 falcon-h1r-7b Open weights TII UAE · Falcon · best of 2 rows 2.27% Independent reasoning on Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 gemma-3n-e4b Open weights Google · Gemma 3 · best of 2 rows 2.27% Independent reasoning off Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 granite-4-0-h-small Open weights IBM · Granite 4.0 · best of 2 rows 2.27% Independent reasoning off Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 granite-4.1-30b Open weights IBM · Granite 4.1 · best of 2 rows 2.27% Independent reasoning off Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 granite-4.1-3b Open weights IBM · Granite 4.1 · best of 2 rows 2.27% Independent reasoning off Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 jamba-1-7-large Open weights AI21 Labs · Jamba 1.7 · best of 2 rows 2.27% Independent reasoning off Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 llama-3-1-nemotron-ultra-253b-v1-reasoning Open weights NVIDIA · Llama 3.1 · best of 2 rows 2.27% Independent reasoning on Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 mi-dm-k-2-5-pro-dec28 Closed Korea Telecom · best of 2 rows 2.27% Independent reasoning on Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 qwen3-8b-instruct Open weights Alibaba Group · Qwen3 · best of 3 rows 2.27% Independent reasoning off Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 sarvam-30b Open weights Sarvam · best of 2 rows 2.27% Independent reasoning_effort high Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 sarvam-m-reasoning Open weights Sarvam · best of 2 rows 2.27% Independent reasoning on Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 solar-open-100b-reasoning Open weights Upstage · Solar · best of 2 rows 2.27% Independent reasoning on Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 240 tri-21b-think-preview Open weights Trillion Labs · best of 2 rows 2.27% Independent reasoning on Partially comparable -3.79 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 256 DeepSeek-R1-0528-Qwen3-8B Open weights DeepSeek · Qwen3 · best of 2 rows 1.52% Independent reasoning on Partially comparable -4.54 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 256 Granite 4.0 Micro Open weights IBM · Granite 4.0 · best of 2 rows 1.52% Independent reasoning off Partially comparable -4.54 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 256 Llama 4 Scout Open weights Meta AI · Llama 4 · best of 2 rows 1.52% Independent reasoning off Partially comparable -4.54 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 256 NVIDIA-Nemotron-Nano-9B-v2 Open weights NVIDIA · Nemotron · best of 4 rows 1.52% Independent reasoning on Partially comparable -4.54 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 256 Qwen3-VL-4B-Instruct Open weights Qwen · Qwen3 · best of 4 rows 1.52% Independent reasoning on Partially comparable -4.54 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 256 R1 Distill Llama 70B Open weights DeepSeek · Llama · best of 2 rows 1.52% Independent reasoning on Partially comparable -4.54 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 256 nova-micro Closed Amazon Web Services · Nova · best of 2 rows 1.52% Independent reasoning off Partially comparable -4.54 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 256 olmo-3-32b-think Open weights Allen Institute for AI · OLMo 3 · best of 2 rows 1.52% Independent reasoning on Partially comparable -4.54 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 256 sarvam-105b Open weights Sarvam · best of 2 rows 1.52% Independent reasoning_effort high Partially comparable -4.54 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 Claude 3 Haiku Closed Anthropic · Claude · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 Command A Open weights Cohere · Command · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 Gemma 3 12B Open weights Google · Gemma 3 · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 Gemma 3 4B Restricted weights Google · Gemma 3 · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 Llama 3.1 8B Restricted weights Meta AI · Llama 3.1 · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 Olmo-3-7B-Think Open weights Allen Institute for AI · OLMo 3 · best of 2 rows 0.76% Independent reasoning on Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 gemma-3n-e2b Open weights Google · Gemma 3 · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 jamba-reasoning-3b Open weights AI21 Labs · Jamba · best of 2 rows 0.76% Independent reasoning on Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 lfm2-2-6b Open weights Liquid AI · LFM2.2 · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 ling-mini-2-0 Open weights inclusionAI · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 llama-3-2-instruct-11b-vision Open weights Meta AI · Llama 3.2 · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 llama-3-instruct-70b Open weights Meta AI · Llama 3 · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 nova-lite Closed Amazon Web Services · Nova · best of 2 rows 0.76% Independent reasoning off Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 265 tri-21b-think-v0-5 Open weights Trillion Labs · best of 2 rows 0.76% Independent reasoning on Partially comparable -5.30 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 LFM2-1.2B Open weights Liquid AI · LFM2.1 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 LFM2.5-1.2B-Instruct Open weights Liquid AI · LFM2.5 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 LFM2.5-VL-1.6B Open weights Liquid AI · LFM2.5 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 Llama-3.2-1B Restricted weights Meta AI · Llama 3.2 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 Ministral 3 3B Open weights Mistral AI · Ministral 3 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 Molmo2-8B Open weights Allen Institute for AI · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 Olmo-3-7B-Instruct Open weights Allen Institute for AI · OLMo 3 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 Qwen3-0.6B Open weights Qwen · Qwen3.0 0% Independent group defaults Partially comparable -6.06 pt obs. 11 Sept 2026 artificialanalysis.ai T2 History 279 Qwen3.5-0.8B Open weights Qwen · Qwen3.5 · best of 4 rows 0% Independent reasoning on Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 Reka Flash 3 Open weights rekaai · best of 2 rows 0% Independent reasoning on Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 apertus-70b-instruct Open weights Swiss AI Initiative · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 apertus-8b-instruct Open weights Swiss AI Initiative · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 exaone-4-0-1-2b Open weights LG AI Research · EXAONE 4.0 · best of 4 rows 0% Independent reasoning on Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 gemma-3-1b Open weights Google · Gemma 3 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 gemma-3-270m Open weights Google · Gemma 3 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 granite-3-3-8b-instruct Open weights IBM · Granite 3.3 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 granite-4-0-350m Open weights IBM · Granite 4.0 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 granite-4-0-h-350m Open weights IBM · Granite 4.0 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 granite-4-0-h-nano-1b Open weights IBM · Granite 4.0 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 granite-4-0-nano-1b Open weights IBM · Granite 4.0 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 granite-4.1-8b Open weights IBM · Granite 4.1 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History 279 jamba-1-7-mini Open weights AI21 Labs · Jamba 1.7 · best of 2 rows 0% Independent reasoning off Partially comparable -6.06 pt obs. 12 Sept 2026 artificialanalysis.ai T2 History