Skip to content
AI Atlas
BenchmarkActivecategory · codingfamily · scicode · variant main

SciCode

scicode-bench.github.io

research-level scientific coding problems

data quality57

Updated 5 h ago · first seen 11 Sept 2026

Metric
accuracy · %
Current results
339
Models
129
Current leader
Claude Fable 5.1 63.1%

Score history · Mistral Small 3.1 2 rows

Score history for Mistral Small 3.10%10%20%30%40%Sept 26Sept 26Sept 26Sept 26Sept 26Sept 26Sept 26Sept 26Sept 26
  • Mistral Small 3.1
  • 27.78%aa_slug=mistral-small-3-1 · evaluator=Artificial Analysis · reasoning=off · index_version=4.312 Sept 2026
  • 27.78%aa_slug=mistral-small-3-1 · evaluator=Artificial Analysis · index_version=4.311 Sept 2026

Back to the leaderboard

Frontier over time · accuracy · evaluator=Artificial Analysis

5 leader changes recorded, all dated 11 Sept 2026 — the frontier line needs at least two distinct dates. The corpus is young: every result was first observed on the same day, so leader changes will separate in time as sources are re-crawled.

  1. 63.1%Claude Fable 5.1 Anthropic Independent11 Sept 2026
  2. 61%Claude Fable 5 Anthropic Independent11 Sept 2026
  3. 59.8%Gemini 3.7 Flash Google Independent11 Sept 2026
  4. 59.5%Kimi K3 Moonshot AI Independent11 Sept 2026
  5. 51.5%Claude Opus 5 Anthropic Independent11 Sept 2026

Includes closed rows (history). A point is emitted whenever a result beats every earlier result of the same group, ordered by evaluated_at when the source publishes it, else observed_at.

Leaderboard 129 models

Select models with +, then Compare.

Leaderboard
#ModelScoreTrustConfigurationvs leaderEvaluatedSourceActions
1Claude Fable 5.1ClosedAnthropic · Claude · best of 10 rows63.1%Independentreasoning_effortmaxleaderobs. 12 Sept 2026artificialanalysis.aiT2History
2Claude Fable 5ClosedAnthropic · Claude · best of 2 rows61%IndependentreasoningonPartially comparable-2.08 ptobs. 12 Sept 2026artificialanalysis.aiT2History
3Gemini 3.7 FlashClosedGoogle · Gemini 3.7 · best of 6 rows59.8%Independentreasoning_effortmediumPartially comparable-3.24 ptobs. 12 Sept 2026artificialanalysis.aiT2History
4Muse Spark 1.3ClosedMeta AI · best of 4 rows59.7%Independentreasoning_effortxhighPartially comparable-3.36 ptobs. 12 Sept 2026artificialanalysis.aiT2History
5Kimi K3Open weightsMoonshot AI · Kimi · best of 4 rows59.5%Independentreasoning_effortmaxComparable-3.59 ptobs. 12 Sept 2026artificialanalysis.aiT2History
6GLM 5.3Open weightsZ.ai (Zhipu AI) · GLM5.3 · best of 2 rows59.0%Independentreasoning_effortmaxComparable-4.05 ptobs. 12 Sept 2026artificialanalysis.aiT2History
7Muse Spark 1.1ClosedMeta AI · best of 2 rows58.8%Independentreasoning_effortxhighPartially comparable-4.28 ptobs. 12 Sept 2026artificialanalysis.aiT2History
8Gemini 3.1 Pro PreviewClosedGoogle · Gemini 3.1 · best of 2 rows58.7%IndependentreasoningonPartially comparable-4.40 ptobs. 12 Sept 2026artificialanalysis.aiT2History
9gpt-5.6-solClosedOpenAI · GPT 5.6 · best of 10 rows57.8%Independentreasoning_efforthighPartially comparable-5.33 ptobs. 12 Sept 2026artificialanalysis.aiT2History
10Muse Spark 1.2ClosedMeta AI · best of 2 rows57.4%Independentreasoning_effortxhighPartially comparable-5.67 ptobs. 12 Sept 2026artificialanalysis.aiT2History
11Gemini 3.8 FlashClosedGoogle · Gemini 3.8 · best of 6 rows56.6%Independentreasoning_efforthighPartially comparable-6.48 ptobs. 12 Sept 2026artificialanalysis.aiT2History
12Grok 4.6ClosedxAI · Grok · best of 8 rows56.5%Independentreasoning_efforthighPartially comparable-6.60 ptobs. 12 Sept 2026artificialanalysis.aiT2History
12gpt-6-astraClosedOpenAI · GPT 6 · best of 11 rows56.5%Independentreasoning_effortmaxComparable-6.60 ptobs. 12 Sept 2026artificialanalysis.aiT2History
14Claude Opus 5ClosedAnthropic · Claude · best of 10 rows56.4%Independentreasoning_effortmaxComparable-6.71 ptobs. 12 Sept 2026artificialanalysis.aiT2History
15gpt-5.5ClosedOpenAI · GPT 5.5 · best of 6 rows56.1%Independentreasoning_efforthighPartially comparable-6.95 ptobs. 12 Sept 2026artificialanalysis.aiT2History
16Grok 4.5ClosedxAI · Grok · best of 2 rows55.0%Independentreasoning_efforthighPartially comparable-8.10 ptobs. 12 Sept 2026artificialanalysis.aiT2History
16gpt-5.6-terraClosedOpenAI · GPT 5.6 · best of 10 rows55.0%Independentreasoning_effortmaxComparable-8.10 ptobs. 12 Sept 2026artificialanalysis.aiT2History
18Claude Opus 4.8ClosedAnthropic · Claude · best of 2 rows54.4%Independentreasoning_effortmaxComparable-8.68 ptobs. 12 Sept 2026artificialanalysis.aiT2History
19Claude Sonnet 5ClosedAnthropic · Claude · best of 10 rows54.3%Independentreasoning_efforthighPartially comparable-8.80 ptobs. 12 Sept 2026artificialanalysis.aiT2History
20Qwen3.8 2.4T A95BOpen weightsQwen · Qwen3.8 · best of 2 rows54.0%IndependentreasoningonPartially comparable-9.03 ptobs. 12 Sept 2026artificialanalysis.aiT2History
21Gemini 3.5 FlashClosedGoogle · Gemini 3.5 · best of 2 rows53.9%IndependentreasoningonPartially comparable-9.14 ptobs. 12 Sept 2026artificialanalysis.aiT2History
22gpt-5.6-lunaClosedOpenAI · GPT 5.6 · best of 10 rows53.6%Independentreasoning_effortmaxComparable-9.49 ptobs. 12 Sept 2026artificialanalysis.aiT2History
23Gemini 3.6 FlashClosedGoogle · Gemini 3.6 · best of 2 rows53.4%IndependentreasoningonPartially comparable-9.72 ptobs. 12 Sept 2026artificialanalysis.aiT2History
24Qwen 3.8 MaxClosedQwen · Qwen3.8 · best of 2 rows53.2%IndependentreasoningonPartially comparable-9.84 ptobs. 12 Sept 2026artificialanalysis.aiT2History
25gpt-5-5-instant-06-26ClosedOpenAI · GPT 5.5 · best of 2 rows52.5%IndependentreasoningonPartially comparable-10.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
26gpt-5.4-miniClosedOpenAI · GPT 5.4 · best of 2 rows52.1%Independentreasoning_effortxhighPartially comparable-11.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
27DeepSeek-V4.1-FlashOpen weightsDeepSeek · DeepSeek · best of 2 rows51.9%Independentreasoning_effortmaxComparable-11.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
28GLM 5.3 FlashOpen weightsZ.ai (Zhipu AI) · GLM5.3 · best of 2 rows51.6%IndependentreasoningonPartially comparable-11.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
28agnes-3-0-flashClosedSapiens AI · best of 2 rows51.6%IndependentreasoningonPartially comparable-11.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
30Kimi K2.6Open weightsMoonshot AI · Kimi · best of 2 rows51.5%IndependentreasoningonPartially comparable-11.6 ptobs. 12 Sept 2026artificialanalysis.aiT2History
31Z.ai GLM 5.2Open weightsZ.ai (Zhipu AI) · GLM5.2 · best of 2 rows51.2%Independentreasoning_effortmaxComparable-11.9 ptobs. 12 Sept 2026artificialanalysis.aiT2History
32deepseek-v4-proClosedDeepSeek · V4 · best of 2 rows51.0%Independentreasoning_effortmaxComparable-12.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
33deepseek-v4-pro-0424Open weightsDeepSeek · DeepSeek · best of 2 rows50.8%Independentreasoning_effortmaxComparable-12.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
34MiMo-V2.5-ProOpen weightsXiaomi · best of 2 rows50.6%IndependentreasoningonPartially comparable-12.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
34Qwen3.8 FlashOpen weightsQwen · Qwen3.8 · best of 2 rows50.6%IndependentreasoningonPartially comparable-12.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
36deepseek-v4-flashOpen weightsDeepSeek · DeepSeek · best of 2 rows50.4%Independentreasoning_effortmaxComparable-12.7 ptobs. 12 Sept 2026artificialanalysis.aiT2History
37Claude Sonnet 4.6ClosedAnthropic · Claude · best of 2 rows50.1%Independentreasoningadaptivereasoning_effortmaxPartially comparable-13.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
37MiniMax M2.7Open weightsMiniMax · MiniMax · best of 2 rows50.1%IndependentreasoningonPartially comparable-13.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
39Inkling SmallOpen weightsThinking Machines · best of 2 rows49.6%IndependentreasoningonPartially comparable-13.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
39deepseek-v4-flash-visionClosedDeepSeek · DeepSeek · best of 2 rows49.6%Independentreasoning_effortmaxComparable-13.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
41Qwen3.7 MaxClosedQwen · Qwen3.7 · best of 2 rows49.5%IndependentreasoningonPartially comparable-13.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
42agnes-2-5-pro-betaClosedSapiens AI · best of 2 rows48.8%IndependentreasoningonPartially comparable-14.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
43Hy3Open weightsTencent · best of 2 rows48.6%IndependentreasoningonPartially comparable-14.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
44Grok 4.3ClosedxAI · Grok · best of 4 rows48.3%Independentreasoning_efforthighPartially comparable-14.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
45quasar-438bClosedMultiverse Computing · best of 2 rows48.1%Independentreasoning_effortmaxComparable-14.9 ptobs. 12 Sept 2026artificialanalysis.aiT2History
46solar-open2-250bOpen weightsUpstage · Solar · best of 2 rows48.0%IndependentreasoningonPartially comparable-15.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
47Kimi K2.7 CodeOpen weightsMoonshot AI · Kimi · best of 2 rows47.8%IndependentreasoningonPartially comparable-15.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
48gpt-5.4-nanoClosedOpenAI · GPT 5.4 · best of 2 rows47.2%Independentreasoning_effortxhighPartially comparable-15.9 ptobs. 12 Sept 2026artificialanalysis.aiT2History
49MiniMax-M3Open weightsMiniMax · MiniMax · best of 2 rows47.1%IndependentreasoningonPartially comparable-16.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
50InklingOpen weightsThinking Machines · best of 2 rows47.0%IndependentreasoningonPartially comparable-16.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
51Qwen3.8 27BOpen weightsQwen · Qwen3.8 · best of 8 rows46.6%Independentreasoning_effortxhighPartially comparable-16.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
52Gemini 2.5 ProClosedGoogle · Gemini 2.5 · best of 2 rows46.3%IndependentreasoningonPartially comparable-16.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
53Qwen 3.7 PlusClosedQwen · Qwen3.7 · best of 2 rows46.1%IndependentreasoningonPartially comparable-17.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
54Claude Sonnet 4.5ClosedAnthropic · Claude · best of 2 rows45.7%IndependentreasoningonPartially comparable-17.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
55Gemma 4 31BOpen weightsGoogle · Gemma 4 · best of 2 rows45.5%IndependentreasoningonPartially comparable-17.6 ptobs. 12 Sept 2026artificialanalysis.aiT2History
55apodex-1-1ClosedApodex · best of 2 rows45.5%IndependentreasoningonPartially comparable-17.6 ptobs. 12 Sept 2026artificialanalysis.aiT2History
57deepseek-v4-flash-0420Open weightsDeepSeek · DeepSeek · best of 3 rows45.3%Independentreasoning_effortmaxComparable-17.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
58ring-2-6-1tOpen weightsinclusionAI · best of 2 rows45.0%IndependentreasoningonPartially comparable-18.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
59Muse Glimmer 30BOpen weightsMeta AI · best of 2 rows44.9%Independentreasoning_efforthighPartially comparable-18.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
60GLM 5.1Open weightsZ.ai (Zhipu AI) · GLM5.1 · best of 2 rows44.8%IndependentreasoningonPartially comparable-18.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
60Qwen3.5 397B A17BOpen weightsQwen · Qwen3.5 · best of 2 rows44.8%IndependentreasoningonPartially comparable-18.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
62Solar Pro 4ClosedUpstage · Solar · best of 2 rows44.6%IndependentreasoningonPartially comparable-18.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
63Ling 3.0 Flash VLOpen weightsinclusionAI · best of 2 rows44.2%IndependentreasoningonPartially comparable-18.9 ptobs. 12 Sept 2026artificialanalysis.aiT2History
64MiMo-V2.5Open weightsXiaomi · best of 2 rows43.9%IndependentreasoningonPartially comparable-19.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
64Step 3.7 FlashOpen weightsStepFun · Step3.7 · best of 2 rows43.9%IndependentreasoningonPartially comparable-19.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
66Gemini 3.1 Flash-Lite PreviewClosedGoogle · Gemini 3.1 · best of 2 rows43.4%IndependentreasoningonPartially comparable-19.7 ptobs. 12 Sept 2026artificialanalysis.aiT2History
67nex-n2-proOpen weightsNex AGI · best of 2 rows43.3%IndependentreasoningonPartially comparable-19.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
68agnes-2-5-pro-alphaOpen weightsSapiens AI · best of 2 rows42.9%IndependentreasoningonPartially comparable-20.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
68k2-horizon-375b-a23bOpen weightsMBZUAI Institute of Foundation Models · best of 2 rows42.9%IndependentreasoningonPartially comparable-20.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
70Qwen3.6 27BOpen weightsQwen · Qwen3.6 · best of 2 rows42.8%IndependentreasoningonPartially comparable-20.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
70o3-miniClosedOpenAI · OpenAI o-series · best of 2 rows42.8%Independentreasoning_efforthighPartially comparable-20.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
72Claude Haiku 4.5ClosedAnthropic · Claude · best of 2 rows42.3%IndependentreasoningonPartially comparable-20.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
72motif-3Open weightsMotif Technologies · best of 2 rows42.3%IndependentreasoningonPartially comparable-20.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
74Ling 3.0 FlashOpen weightsinclusionAI · best of 2 rows42.0%IndependentreasoningonPartially comparable-21.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
74k-exaone-2-0-0803Open weightsLG AI Research · EXAONE 2.0 · best of 2 rows42.0%IndependentreasoningonPartially comparable-21.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
76Qwen3 235B A22B Instruct 2507Open weightsQwen · Qwen3 · best of 2 rows41.4%IndependentreasoningonPartially comparable-21.6 ptobs. 12 Sept 2026artificialanalysis.aiT2History
77Gemini 3.5 Flash-LiteClosedGoogle · Gemini 3.5 · best of 2 rows41.3%IndependentreasoningonPartially comparable-21.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
78a-x-k2Open weightsSK Telecom · best of 2 rows41.0%IndependentreasoningonPartially comparable-22.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
79Trinity Large ThinkingOpen weightsArcee AI · best of 2 rows40.6%IndependentreasoningonPartially comparable-22.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
80Nemotron 3 UltraOpen weightsNVIDIA · Nemotron 3 · best of 2 rows40.3%IndependentreasoningonPartially comparable-22.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
81Mistral Medium 3.5Open weightsMistral AI · Mistral · best of 2 rows40.2%IndependentreasoningonPartially comparable-22.9 ptobs. 12 Sept 2026artificialanalysis.aiT2History
81deepseek-v4-flash-0420-highOpen weightsDeepSeek · DeepSeek40.2%Independentgroup defaultsPartially comparable-22.9 ptobs. 11 Sept 2026artificialanalysis.aiT2History
83Qwen3.5-122B-A10BOpen weightsQwen · Qwen3.5 · best of 2 rows39.7%IndependentreasoningonPartially comparable-23.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
84DeepSeek V3 0324Open weightsDeepSeek · DeepSeek-V3 · best of 2 rows39%IndependentreasoningoffPartially comparable-24.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
84gpt-5-miniClosedOpenAI · GPT 5 · best of 2 rows39%Independentreasoning_efforthighPartially comparable-24.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
86gpt-oss-20bOpen weightsOpenAI · gpt-oss · best of 2 rows38.9%Independentreasoning_efforthighPartially comparable-24.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
87Mistral Small 4Open weightsMistral AI · Mistral · best of 2 rows38.8%IndependentreasoningonPartially comparable-24.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
87North Mini Code (free)Open weightsCohere · best of 2 rows38.8%IndependentreasoningonPartially comparable-24.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
89command-a-plusOpen weightsCohere · Command · best of 2 rows38.5%IndependentreasoningonPartially comparable-24.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
90deepseek-r1-0120Open weightsDeepSeek · DeepSeek · best of 2 rows38.3%IndependentreasoningonPartially comparable-24.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
91DeepSeek V3.1 TerminusOpen weightsDeepSeek · DeepSeek · best of 2 rows38.0%IndependentreasoningonPartially comparable-25.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
92granite-4.2-30bOpen weightsIBM · Granite 4.2 · best of 2 rows37.9%IndependentreasoningonPartially comparable-25.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
93Mercury 2ClosedInception · best of 2 rows37.7%IndependentreasoningonPartially comparable-25.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
94g9v3-39a5bOpen weightsAI9Stars · best of 2 rows36.8%IndependentreasoningonPartially comparable-26.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
95Mistral Large 3Open weightsMistral AI · Mistral · best of 2 rows36.6%IndependentreasoningoffPartially comparable-26.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
95Qwen3.6 35B A3BOpen weightsQwen · Qwen3.6 · best of 2 rows36.6%IndependentreasoningonPartially comparable-26.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
97LongCat 2.0Open weightsMeituan · best of 2 rows36.3%IndependentreasoningonPartially comparable-26.7 ptobs. 12 Sept 2026artificialanalysis.aiT2History
98Nemotron 3 SuperOpen weightsNVIDIA · Nemotron 3 · best of 2 rows36.2%IndependentreasoningonPartially comparable-26.9 ptobs. 12 Sept 2026artificialanalysis.aiT2History
98Qwen3 Coder NextOpen weightsQwen · Qwen3 · best of 2 rows36.2%IndependentreasoningoffPartially comparable-26.9 ptobs. 12 Sept 2026artificialanalysis.aiT2History
100Qwen3 32BOpen weightsQwen · Qwen336%Independentgroup defaultsPartially comparable-27.1 ptobs. 11 Sept 2026artificialanalysis.aiT2History

One row per canonical model — its best current row inside this comparability group (effort variants are folded into the model). Bars are relative to the page's best score. “vs leader” reads comparability: partially comparable = same task, conditions differ (reasoning effort, temperature, judge). Rules →