301 Qwen2.5 72B Instruct Open weights Qwen · Qwen2.5 · best of 2 rows 7.73 Independent reasoning off version 4.3 Partially comparable 0.00 obs. 12 Sept 2026 artificialanalysis.ai T2 History 302 step-3-vl-10b Open weights StepFun · Step3 · best of 2 rows 7.69 Independent reasoning on version 4.3 Partially comparable -0.04 obs. 12 Sept 2026 artificialanalysis.ai T2 History 303 Llama 3.3 70B Open weights Meta AI · Llama 3.3 · best of 2 rows 7.66 Independent reasoning off version 4.3 Partially comparable -0.07 obs. 12 Sept 2026 artificialanalysis.ai T2 History 304 qwen3-30b-a3b-instruct Open weights Alibaba Group · Qwen3 · best of 4 rows 7.63 Independent reasoning on version 4.3 Partially comparable -0.10 obs. 12 Sept 2026 artificialanalysis.ai T2 History 305 Sonar Pro Closed Perplexity AI · Sonar · best of 2 rows 7.61 Independent reasoning off version 4.3 Partially comparable -0.12 obs. 12 Sept 2026 artificialanalysis.ai T2 History 306 devstral-small Open weights Mistral AI · Devstral · best of 2 rows 7.60 Independent reasoning off version 4.3 Partially comparable -0.13 obs. 12 Sept 2026 artificialanalysis.ai T2 History 307 QwQ-32B-Preview Open weights Alibaba Group · Qwen · best of 2 rows 7.59 Independent reasoning on version 4.3 Partially comparable -0.14 obs. 12 Sept 2026 artificialanalysis.ai T2 History 308 GLM 4.5V Open weights Z.ai (Zhipu AI) · GLM4.5 · best of 4 rows 7.56 Independent reasoning on version 4.3 Partially comparable -0.17 obs. 12 Sept 2026 artificialanalysis.ai T2 History 308 mistral-large-2 Open weights Mistral AI · Mistral · best of 2 rows 7.56 Independent reasoning off version 4.3 Partially comparable -0.17 obs. 12 Sept 2026 artificialanalysis.ai T2 History 310 llama-3-1-nemotron-ultra-253b-v1-reasoning Open weights NVIDIA · Llama 3.1 · best of 2 rows 7.53 Independent reasoning on version 4.3 Partially comparable -0.20 obs. 12 Sept 2026 artificialanalysis.ai T2 History 311 ernie-4-5-300b-a47b Open weights Baidu · ERNIE 4.5 · best of 2 rows 7.50 Independent reasoning off version 4.3 Partially comparable -0.23 obs. 12 Sept 2026 artificialanalysis.ai T2 History 312 Hermes 4 405B Open weights Nous Research · Hermes 4 7.49 Independent version 4.3 Partially comparable -0.24 obs. 11 Sept 2026 artificialanalysis.ai T2 History 312 hermes-4-llama-3-1-405b Open weights Nous Research · Llama 3.1 · best of 3 rows 7.49 Independent reasoning on version 4.3 Partially comparable -0.24 obs. 12 Sept 2026 artificialanalysis.ai T2 History 314 nvidia-nemotron-nano-12b-v2-vl Open weights NVIDIA · Nemotron · best of 4 rows 7.48 Independent reasoning on version 4.3 Partially comparable -0.25 obs. 12 Sept 2026 artificialanalysis.ai T2 History 315 granite-4.1-30b Open weights IBM · Granite 4.1 · best of 2 rows 7.44 Independent reasoning off version 4.3 Partially comparable -0.29 obs. 12 Sept 2026 artificialanalysis.ai T2 History 316 NVIDIA-Nemotron-Nano-9B-v2 Open weights NVIDIA · Nemotron · best of 4 rows 7.43 Independent reasoning on version 4.3 Partially comparable -0.30 obs. 12 Sept 2026 artificialanalysis.ai T2 History 317 gemini-2-0-flash-lite-001 Closed Google · Gemini 2.0 · best of 2 rows 7.41 Independent reasoning off version 4.3 Partially comparable -0.32 obs. 12 Sept 2026 artificialanalysis.ai T2 History 318 nvidia-nemotron-3-nano-4b Open weights NVIDIA · Nemotron 3 · best of 2 rows 7.38 Independent reasoning on version 4.3 Partially comparable -0.35 obs. 12 Sept 2026 artificialanalysis.ai T2 History 319 Mistral Small 3.1 Open weights Mistral AI · Mistral · best of 2 rows 7.37 Independent reasoning off version 4.3 Partially comparable -0.36 obs. 12 Sept 2026 artificialanalysis.ai T2 History 320 qwen3-32b-instruct Open weights Alibaba Group · Qwen3 · best of 3 rows 7.34 Independent reasoning off version 4.3 Partially comparable -0.39 obs. 12 Sept 2026 artificialanalysis.ai T2 History 321 GPT-4o (2024-05-13) Closed OpenAI · GPT 4 · best of 2 rows 7.33 Independent reasoning off version 4.3 Partially comparable -0.40 obs. 12 Sept 2026 artificialanalysis.ai T2 History 321 gemini-2-0-flash-lite-preview Closed Google · Gemini 2.0 · best of 2 rows 7.33 Independent reasoning off version 4.3 Partially comparable -0.40 obs. 12 Sept 2026 artificialanalysis.ai T2 History 323 llama-3-1-nemotron-nano-4b-reasoning Open weights NVIDIA · Llama 3.1 · best of 2 rows 7.31 Independent reasoning on version 4.3 Partially comparable -0.42 obs. 12 Sept 2026 artificialanalysis.ai T2 History 324 Kimi-Linear-48B-A3B-Instruct Open weights Moonshot AI · Kimi · best of 2 rows 7.30 Independent reasoning off version 4.3 Partially comparable -0.43 obs. 12 Sept 2026 artificialanalysis.ai T2 History 325 Llama-3.1-405B Restricted weights Meta AI · Llama 3.1 · best of 2 rows 7.29 Independent reasoning off version 4.3 Partially comparable -0.44 obs. 12 Sept 2026 artificialanalysis.ai T2 History 326 Qwen3-4B Open weights Qwen · Qwen3 7.23 Independent version 4.3 Partially comparable -0.50 obs. 11 Sept 2026 artificialanalysis.ai T2 History 326 qwen3-4b-instruct Open weights Alibaba Group · Qwen3 · best of 3 rows 7.23 Independent reasoning on version 4.3 Partially comparable -0.50 obs. 12 Sept 2026 artificialanalysis.ai T2 History 328 LFM2.5-8B-A1B Open weights Liquid AI · LFM2.5 · best of 2 rows 7.22 Independent reasoning on version 4.3 Partially comparable -0.51 obs. 12 Sept 2026 artificialanalysis.ai T2 History 328 Qwen3 32B Open weights Qwen · Qwen3 7.22 Independent version 4.3 Partially comparable -0.51 obs. 11 Sept 2026 artificialanalysis.ai T2 History 330 claude-35-sonnet-june-24 Closed Anthropic · Claude 35 · best of 2 rows 7.21 Independent reasoning off version 4.3 Partially comparable -0.52 obs. 12 Sept 2026 artificialanalysis.ai T2 History 331 tulu3-405b Open weights Allen Institute for AI · best of 2 rows 7.20 Independent reasoning off version 4.3 Partially comparable -0.53 obs. 12 Sept 2026 artificialanalysis.ai T2 History 332 gpt-4o-chatgpt Closed OpenAI · GPT 4 · best of 2 rows 7.19 Independent reasoning off version 4.3 Partially comparable -0.54 obs. 12 Sept 2026 artificialanalysis.ai T2 History 333 Pixtral Large Open weights Mistral AI · Pixtral · best of 2 rows 7.15 Independent reasoning off version 4.3 Partially comparable -0.58 obs. 12 Sept 2026 artificialanalysis.ai T2 History 333 ring-flash-2-0 Open weights inclusionAI · best of 2 rows 7.15 Independent reasoning on version 4.3 Partially comparable -0.58 obs. 12 Sept 2026 artificialanalysis.ai T2 History 335 olmo-3-1-32b-instruct Open weights Allen Institute for AI · OLMo 3.1 · best of 3 rows 7.12 Independent reasoning on version 4.3 Partially comparable -0.61 obs. 12 Sept 2026 artificialanalysis.ai T2 History 336 grok-2 Open weights xAI · Grok 2 · best of 2 rows 7.11 Independent reasoning off version 4.3 Partially comparable -0.62 obs. 12 Sept 2026 artificialanalysis.ai T2 History 337 gemini-1-5-flash Closed Google · Gemini 1.5 · best of 2 rows 7.07 Independent reasoning off version 4.3 Partially comparable -0.66 obs. 12 Sept 2026 artificialanalysis.ai T2 History 338 Qwen3-VL-4B-Instruct Open weights Qwen · Qwen3 · best of 4 rows 7.05 Independent reasoning on version 4.3 Partially comparable -0.68 obs. 12 Sept 2026 artificialanalysis.ai T2 History 339 gpt-4-turbo Closed OpenAI · GPT 4 · best of 2 rows 7.04 Independent reasoning off version 4.3 Partially comparable -0.69 obs. 12 Sept 2026 artificialanalysis.ai T2 History 340 Command A Open weights Cohere · Command · best of 2 rows 6.96 Independent reasoning off version 4.3 Partially comparable -0.77 obs. 12 Sept 2026 artificialanalysis.ai T2 History 340 Mistral Small 3.2 Open weights Mistral AI · Mistral · best of 2 rows 6.96 Independent reasoning off version 4.3 Partially comparable -0.77 obs. 12 Sept 2026 artificialanalysis.ai T2 History 340 nova-pro Closed Amazon Web Services · Nova · best of 2 rows 6.96 Independent reasoning off version 4.3 Partially comparable -0.77 obs. 12 Sept 2026 artificialanalysis.ai T2 History 343 Qwen3.5-2B Open weights Qwen · Qwen3.5 · best of 4 rows 6.94 Independent reasoning on version 4.3 Partially comparable -0.79 obs. 12 Sept 2026 artificialanalysis.ai T2 History 343 llama-3-1-nemotron-instruct-70b Open weights NVIDIA · Llama 3.1 · best of 2 rows 6.94 Independent reasoning off version 4.3 Partially comparable -0.79 obs. 12 Sept 2026 artificialanalysis.ai T2 History 345 Llama 3.1 8B Restricted weights Meta AI · Llama 3.1 · best of 2 rows 6.93 Independent reasoning off version 4.3 Partially comparable -0.80 obs. 12 Sept 2026 artificialanalysis.ai T2 History 346 grok-beta Closed SpaceXAI · Grok · best of 2 rows 6.89 Independent reasoning off version 4.3 Partially comparable -0.84 obs. 12 Sept 2026 artificialanalysis.ai T2 History 347 qwen2.5-32b-instruct Open weights Alibaba Group · Qwen2.5 · best of 2 rows 6.87 Independent reasoning off version 4.3 Partially comparable -0.86 obs. 12 Sept 2026 artificialanalysis.ai T2 History 348 Mistral Large 2.0 Open weights Mistral AI · Mistral · best of 2 rows 6.80 Independent reasoning off version 4.3 Partially comparable -0.93 obs. 12 Sept 2026 artificialanalysis.ai T2 History 349 Qwen2.5 Coder 32B Instruct Open weights Qwen · Qwen2.5 · best of 2 rows 6.74 Independent reasoning off version 4.3 Partially comparable -0.99 obs. 12 Sept 2026 artificialanalysis.ai T2 History 350 gpt-4 Closed OpenAI · GPT 4 · best of 2 rows 6.70 Independent reasoning off version 4.3 Partially comparable -1.03 obs. 12 Sept 2026 artificialanalysis.ai T2 History 350 qwen3-14b-instruct Open weights Alibaba Group · Qwen3 · best of 3 rows 6.70 Independent reasoning off version 4.3 Partially comparable -1.03 obs. 12 Sept 2026 artificialanalysis.ai T2 History 352 Mistral Small 3 Open weights Mistral AI · Mistral · best of 2 rows 6.67 Independent reasoning off version 4.3 Partially comparable -1.06 obs. 12 Sept 2026 artificialanalysis.ai T2 History 352 nova-lite Closed Amazon Web Services · Nova · best of 2 rows 6.67 Independent reasoning off version 4.3 Partially comparable -1.06 obs. 12 Sept 2026 artificialanalysis.ai T2 History 354 gpt-4o-mini Closed OpenAI · GPT 4 · best of 2 rows 6.66 Independent reasoning off version 4.3 Partially comparable -1.07 obs. 12 Sept 2026 artificialanalysis.ai T2 History 355 deepseek-v2-5 Open weights DeepSeek · DeepSeek · best of 2 rows 6.62 Independent reasoning off version 4.3 Partially comparable -1.11 obs. 12 Sept 2026 artificialanalysis.ai T2 History 356 Llama-3.1-70B Open weights Meta AI · Llama 3.1 · best of 2 rows 6.60 Independent reasoning off version 4.3 Partially comparable -1.13 obs. 12 Sept 2026 artificialanalysis.ai T2 History 357 granite-4.1-8b Open weights IBM · Granite 4.1 · best of 2 rows 6.57 Independent reasoning off version 4.3 Partially comparable -1.16 obs. 12 Sept 2026 artificialanalysis.ai T2 History 358 gemini-2-0-flash-thinking-exp-1219 Closed Google · Gemini 2.0 · best of 2 rows 6.56 Independent reasoning on version 4.3 Partially comparable -1.17 obs. 12 Sept 2026 artificialanalysis.ai T2 History 358 sarvam-30b Open weights Sarvam · best of 2 rows 6.56 Independent reasoning_effort high version 4.3 Partially comparable -1.17 obs. 12 Sept 2026 artificialanalysis.ai T2 History 360 deepseek-v2-5-sep-2024 Open weights DeepSeek · DeepSeek · best of 2 rows 6.55 Independent reasoning off version 4.3 Partially comparable -1.18 obs. 12 Sept 2026 artificialanalysis.ai T2 History 361 Mistral Saba Closed Mistral AI · Mistral · best of 2 rows 6.49 Independent reasoning off version 4.3 Partially comparable -1.24 obs. 12 Sept 2026 artificialanalysis.ai T2 History 362 deepseek-r1-distill-llama-8b Open weights DeepSeek · Llama · best of 2 rows 6.48 Independent reasoning on version 4.3 Partially comparable -1.25 obs. 12 Sept 2026 artificialanalysis.ai T2 History 363 olmo-3-32b-think Open weights Allen Institute for AI · OLMo 3 · best of 2 rows 6.47 Independent reasoning on version 4.3 Partially comparable -1.26 obs. 12 Sept 2026 artificialanalysis.ai T2 History 364 Llama 4 Scout Open weights Meta AI · Llama 4 · best of 2 rows 6.45 Independent reasoning off version 4.3 Partially comparable -1.28 obs. 12 Sept 2026 artificialanalysis.ai T2 History 365 gemini-1-5-pro-may-2024 Closed Google · Gemini 1.5 · best of 2 rows 6.44 Independent reasoning off version 4.3 Partially comparable -1.29 obs. 12 Sept 2026 artificialanalysis.ai T2 History 365 r1-1776 Open weights Perplexity AI · best of 2 rows 6.44 Independent reasoning on version 4.3 Partially comparable -1.29 obs. 12 Sept 2026 artificialanalysis.ai T2 History 367 qwen-turbo Closed Alibaba Group · Qwen · best of 2 rows 6.43 Independent reasoning off version 4.3 Partially comparable -1.30 obs. 12 Sept 2026 artificialanalysis.ai T2 History 367 reka-flash Closed rekaai · best of 2 rows 6.43 Independent reasoning off version 4.3 Partially comparable -1.30 obs. 12 Sept 2026 artificialanalysis.ai T2 History 369 llama-3-2-instruct-90b-vision Open weights Meta AI · Llama 3.2 · best of 2 rows 6.41 Independent reasoning off version 4.3 Partially comparable -1.32 obs. 12 Sept 2026 artificialanalysis.ai T2 History 369 solar-mini Open weights Upstage · Solar · best of 2 rows 6.41 Independent reasoning off version 4.3 Partially comparable -1.32 obs. 12 Sept 2026 artificialanalysis.ai T2 History 371 Qwen3 14B Open weights Qwen · Qwen3 6.39 Independent version 4.3 Partially comparable -1.34 obs. 11 Sept 2026 artificialanalysis.ai T2 History 372 celeris-1 Closed Celeris · best of 2 rows 6.35 Independent reasoning off version 4.3 Partially comparable -1.38 obs. 12 Sept 2026 artificialanalysis.ai T2 History 373 grok-1 Open weights xAI · Grok 1 · best of 2 rows 6.34 Independent reasoning off version 4.3 Partially comparable -1.39 obs. 12 Sept 2026 artificialanalysis.ai T2 History 374 phi-4-mini Open weights Microsoft · Phi4 · best of 2 rows 6.33 Independent reasoning off version 4.3 Partially comparable -1.40 obs. 12 Sept 2026 artificialanalysis.ai T2 History 374 qwen2-72b-instruct Open weights Alibaba Group · Qwen2 · best of 2 rows 6.33 Independent reasoning off version 4.3 Partially comparable -1.40 obs. 12 Sept 2026 artificialanalysis.ai T2 History 376 gemini-1-5-flash-8b Closed Google · Gemini 1.5 · best of 2 rows 6.15 Independent reasoning off version 4.3 Partially comparable -1.58 obs. 12 Sept 2026 artificialanalysis.ai T2 History 377 Qwen3.5-0.8B Open weights Qwen · Qwen3.5 · best of 4 rows 6.13 Independent reasoning on version 4.3 Partially comparable -1.60 obs. 12 Sept 2026 artificialanalysis.ai T2 History 378 deephermes-3-mistral-24b-preview Open weights Nous Research · Mistral · best of 2 rows 6.07 Independent reasoning off version 4.3 Partially comparable -1.66 obs. 12 Sept 2026 artificialanalysis.ai T2 History 378 jamba-1-7-large Open weights AI21 Labs · Jamba 1.7 · best of 2 rows 6.07 Independent reasoning off version 4.3 Partially comparable -1.66 obs. 12 Sept 2026 artificialanalysis.ai T2 History 380 granite-4-0-h-small Open weights IBM · Granite 4.0 · best of 2 rows 6.05 Independent reasoning off version 4.3 Partially comparable -1.68 obs. 12 Sept 2026 artificialanalysis.ai T2 History 381 Ministral 3 14B Open weights Mistral AI · Ministral 3 · best of 2 rows 6.04 Independent reasoning off version 4.3 Partially comparable -1.69 obs. 12 Sept 2026 artificialanalysis.ai T2 History 382 jamba-1-5-large Open weights AI21 Labs · Jamba 1.5 · best of 2 rows 6.01 Independent reasoning off version 4.3 Partially comparable -1.72 obs. 12 Sept 2026 artificialanalysis.ai T2 History 383 Hermes 3 70B Instruct Open weights Nous Research · Hermes 3 · best of 2 rows 6 Independent reasoning off version 4.3 Partially comparable -1.73 obs. 12 Sept 2026 artificialanalysis.ai T2 History 384 qwen3-8b-instruct Open weights Alibaba Group · Qwen3 · best of 3 rows 5.99 Independent reasoning off version 4.3 Partially comparable -1.74 obs. 12 Sept 2026 artificialanalysis.ai T2 History 385 deepseek-coder-v2 Open weights DeepSeek · DeepSeek · best of 2 rows 5.98 Independent reasoning off version 4.3 Partially comparable -1.75 obs. 12 Sept 2026 artificialanalysis.ai T2 History 386 jamba-1-6-large Open weights AI21 Labs · Jamba 1.6 · best of 2 rows 5.97 Independent reasoning off version 4.3 Partially comparable -1.76 obs. 12 Sept 2026 artificialanalysis.ai T2 History 386 olmo-2-32b Open weights Allen Institute for AI · OLMo 2 · best of 2 rows 5.97 Independent reasoning off version 4.3 Partially comparable -1.76 obs. 12 Sept 2026 artificialanalysis.ai T2 History 388 lfm2-24b-a2b Open weights Liquid AI · LFM2 · best of 2 rows 5.95 Independent reasoning off version 4.3 Partially comparable -1.78 obs. 12 Sept 2026 artificialanalysis.ai T2 History 389 gemini-1-5-flash-may-2024 Closed Google · Gemini 1.5 · best of 2 rows 5.94 Independent reasoning off version 4.3 Partially comparable -1.79 obs. 12 Sept 2026 artificialanalysis.ai T2 History 390 Phi 4 Open weights Microsoft · Phi4 · best of 2 rows 5.92 Independent reasoning off version 4.3 Partially comparable -1.81 obs. 12 Sept 2026 artificialanalysis.ai T2 History 391 claude-3-sonnet Closed Anthropic · Claude 3 · best of 2 rows 5.88 Independent reasoning off version 4.3 Partially comparable -1.85 obs. 12 Sept 2026 artificialanalysis.ai T2 History 391 nova-micro Closed Amazon Web Services · Nova · best of 2 rows 5.88 Independent reasoning off version 4.3 Partially comparable -1.85 obs. 12 Sept 2026 artificialanalysis.ai T2 History 393 granite-4.1-3b Open weights IBM · Granite 4.1 · best of 2 rows 5.86 Independent reasoning off version 4.3 Partially comparable -1.87 obs. 12 Sept 2026 artificialanalysis.ai T2 History 394 mistral-small Open weights Mistral AI · Mistral · best of 2 rows 5.85 Independent reasoning off version 4.3 Partially comparable -1.88 obs. 12 Sept 2026 artificialanalysis.ai T2 History 395 gemini-1-0-ultra Closed Google · Gemini 1.0 · best of 2 rows 5.84 Independent reasoning off version 4.3 Partially comparable -1.89 obs. 12 Sept 2026 artificialanalysis.ai T2 History 396 phi-3-mini Open weights Microsoft · Phi3 · best of 2 rows 5.82 Independent reasoning off version 4.3 Partially comparable -1.91 obs. 12 Sept 2026 artificialanalysis.ai T2 History 397 gemma-3n-e4b-preview-0520 Open weights Google · Gemma 3 · best of 2 rows 5.81 Independent reasoning off version 4.3 Partially comparable -1.92 obs. 12 Sept 2026 artificialanalysis.ai T2 History 397 phi-4-multimodal Open weights Microsoft · Phi4 · best of 2 rows 5.81 Independent reasoning off version 4.3 Partially comparable -1.92 obs. 12 Sept 2026 artificialanalysis.ai T2 History 399 Qwen2.5-Coder-7B Open weights Qwen · Qwen2.5 · best of 2 rows 5.79 Independent reasoning off version 4.3 Partially comparable -1.94 obs. 12 Sept 2026 artificialanalysis.ai T2 History 400 Mistral Large Closed Mistral AI · Mistral · best of 2 rows 5.76 Independent reasoning off version 4.3 Partially comparable -1.97 obs. 12 Sept 2026 artificialanalysis.ai T2 History