Skip to content
AI Atlas
BenchmarkActivecategory · reasoningfamily · gpqa · variant Diamond

GPQA Diamond

github.com/idavidrein/gpqa

graduate-level science questions — the 198-question Diamond subset (expert-validated, non-expert-failed)

data quality57

Updated 5 h ago · first seen 12 Sept 2026

Metric
accuracy · %
Current results
1,227
Models
459
Current leader
gpt-6-astra 96.3%

Frontier over time · accuracy · variant=Diamond · evaluator=Artificial Analysis

9 leader changes recorded, all dated 12 Sept 2026 — the frontier line needs at least two distinct dates. The corpus is young: every result was first observed on the same day, so leader changes will separate in time as sources are re-crawled.

  1. 96.3%gpt-6-astra OpenAI Independent12 Sept 2026
  2. 96.1%gpt-6-astra OpenAI Independent12 Sept 2026
  3. 95.3%Gemini 3.8 Flash Google Independent12 Sept 2026
  4. 95.0%gpt-6-astra OpenAI Independent12 Sept 2026
  5. 93.9%gpt-6-astra OpenAI Independent12 Sept 2026
  6. 93.5%Kimi K3 Moonshot AI Independent12 Sept 2026
  7. 91.9%Claude Opus 5 Anthropic Independent12 Sept 2026
  8. 79.1%grok-3-mini-reasoning SpaceXAI Independent12 Sept 2026

Includes closed rows (history). A point is emitted whenever a result beats every earlier result of the same group, ordered by evaluated_at when the source publishes it, else observed_at.

Leaderboard 440 models

Select models with +, then Compare.

Leaderboard
#ModelScoreTrustConfigurationvs leaderEvaluatedSourceActions
301qwen3-4b-instructOpen weightsAlibaba Group · Qwen3 · best of 2 rows52.2%IndependentreasoningonPartially comparable0.00 ptobs. 12 Sept 2026artificialanalysis.aiT2History
302GPT-4o (2024-08-06)ClosedOpenAI · GPT 452.1%IndependentreasoningoffPartially comparable-0.10 ptobs. 12 Sept 2026artificialanalysis.aiT2History
303Olmo-3-7B-ThinkOpen weightsAllen Institute for AI · OLMo 351.6%IndependentreasoningonPartially comparable-0.60 ptobs. 12 Sept 2026artificialanalysis.aiT2History
303Qwen3 Coder 30B A3B InstructOpen weightsQwen · Qwen351.6%IndependentreasoningoffPartially comparable-0.60 ptobs. 12 Sept 2026artificialanalysis.aiT2History
303tulu3-405bOpen weightsAllen Institute for AI51.6%IndependentreasoningoffPartially comparable-0.60 ptobs. 12 Sept 2026artificialanalysis.aiT2History
306Llama-3.1-405BRestricted weightsMeta AI · Llama 3.151.5%IndependentreasoningoffPartially comparable-0.70 ptobs. 12 Sept 2026artificialanalysis.aiT2History
306exaone-4-0-1-2bOpen weightsLG AI Research · EXAONE 4.0 · best of 2 rows51.5%IndependentreasoningonPartially comparable-0.70 ptobs. 12 Sept 2026artificialanalysis.aiT2History
308LFM2.5-8B-A1BOpen weightsLiquid AI · LFM2.551.3%IndependentreasoningonPartially comparable-0.91 ptobs. 12 Sept 2026artificialanalysis.aiT2History
308nvidia-nemotron-3-nano-4bOpen weightsNVIDIA · Nemotron 351.3%IndependentreasoningonPartially comparable-0.91 ptobs. 12 Sept 2026artificialanalysis.aiT2History
310gpt-4.1-nanoClosedOpenAI · GPT 4.151.2%IndependentreasoningoffPartially comparable-1.01 ptobs. 12 Sept 2026artificialanalysis.aiT2History
311gpt-4o-chatgptClosedOpenAI · GPT 451.1%IndependentreasoningoffPartially comparable-1.11 ptobs. 12 Sept 2026artificialanalysis.aiT2History
312grok-2Open weightsxAI · Grok 251.0%IndependentreasoningoffPartially comparable-1.21 ptobs. 12 Sept 2026artificialanalysis.aiT2History
313Mistral Small 3.2Open weightsMistral AI · Mistral50.5%IndependentreasoningoffPartially comparable-1.71 ptobs. 12 Sept 2026artificialanalysis.aiT2History
313Pixtral LargeOpen weightsMistral AI · Pixtral50.5%IndependentreasoningoffPartially comparable-1.71 ptobs. 12 Sept 2026artificialanalysis.aiT2History
315nova-proClosedAmazon Web Services · Nova49.9%IndependentreasoningoffPartially comparable-2.32 ptobs. 12 Sept 2026artificialanalysis.aiT2History
316Llama 3.3 70BOpen weightsMeta AI · Llama 3.349.8%IndependentreasoningoffPartially comparable-2.42 ptobs. 12 Sept 2026artificialanalysis.aiT2History
317Qwen3-VL-4B-InstructOpen weightsQwen · Qwen3 · best of 2 rows49.4%IndependentreasoningonPartially comparable-2.83 ptobs. 12 Sept 2026artificialanalysis.aiT2History
318devstral-mediumClosedMistral AI · Devstral49.2%IndependentreasoningoffPartially comparable-3.03 ptobs. 12 Sept 2026artificialanalysis.aiT2History
319Qwen2.5 72B InstructOpen weightsQwen · Qwen2.549.1%IndependentreasoningoffPartially comparable-3.13 ptobs. 12 Sept 2026artificialanalysis.aiT2History
320claude-3-opusClosedAnthropic · Claude 348.9%IndependentreasoningoffPartially comparable-3.33 ptobs. 12 Sept 2026artificialanalysis.aiT2History
321mistral-large-2Open weightsMistral AI · Mistral48.6%IndependentreasoningoffPartially comparable-3.63 ptobs. 12 Sept 2026artificialanalysis.aiT2History
322deepseek-r1-distill-qwen-14bOpen weightsDeepSeek · Qwen48.4%IndependentreasoningonPartially comparable-3.84 ptobs. 12 Sept 2026artificialanalysis.aiT2History
323granite-4.1-30bOpen weightsIBM · Granite 4.148.1%IndependentreasoningoffPartially comparable-4.14 ptobs. 12 Sept 2026artificialanalysis.aiT2History
324lfm2-24b-a2bOpen weightsLiquid AI · LFM247.4%IndependentreasoningoffPartially comparable-4.85 ptobs. 12 Sept 2026artificialanalysis.aiT2History
325Mistral Large 2.0Open weightsMistral AI · Mistral47.2%IndependentreasoningoffPartially comparable-5.05 ptobs. 12 Sept 2026artificialanalysis.aiT2History
326Ministral 3 8BOpen weightsMistral AI · Ministral 347.1%IndependentreasoningoffPartially comparable-5.15 ptobs. 12 Sept 2026artificialanalysis.aiT2History
326grok-betaClosedSpaceXAI · Grok47.1%IndependentreasoningoffPartially comparable-5.15 ptobs. 12 Sept 2026artificialanalysis.aiT2History
328nemotron-3-nano-omni-30b-a3bOpen weightsNVIDIA · Nemotron 346.9%IndependentreasoningonPartially comparable-5.35 ptobs. 12 Sept 2026artificialanalysis.aiT2History
329qwen2.5-32b-instructOpen weightsAlibaba Group · Qwen2.546.6%IndependentreasoningoffPartially comparable-5.65 ptobs. 12 Sept 2026artificialanalysis.aiT2History
330llama-3-1-nemotron-instruct-70bOpen weightsNVIDIA · Llama 3.146.5%IndependentreasoningoffPartially comparable-5.76 ptobs. 12 Sept 2026artificialanalysis.aiT2History
331gemini-1-5-flashClosedGoogle · Gemini 1.546.3%IndependentreasoningoffPartially comparable-5.96 ptobs. 12 Sept 2026artificialanalysis.aiT2History
332Mistral Small 3Open weightsMistral AI · Mistral46.2%IndependentreasoningoffPartially comparable-6.06 ptobs. 12 Sept 2026artificialanalysis.aiT2History
333Qwen3.5-2BOpen weightsQwen · Qwen3.5 · best of 2 rows45.6%IndependentreasoningonPartially comparable-6.66 ptobs. 12 Sept 2026artificialanalysis.aiT2History
334Mistral Small 3.1Open weightsMistral AI · Mistral45.4%IndependentreasoningoffPartially comparable-6.87 ptobs. 12 Sept 2026artificialanalysis.aiT2History
335g9v3-3bOpen weightsAI9Stars43.8%IndependentreasoningonPartially comparable-8.38 ptobs. 12 Sept 2026artificialanalysis.aiT2History
336Devstral Small 1.0Open weightsMistral AI · Devstral43.4%IndependentreasoningoffPartially comparable-8.79 ptobs. 12 Sept 2026artificialanalysis.aiT2History
337gemma-4-E2BOpen weightsGoogle · Gemma 4 · best of 2 rows43.3%IndependentreasoningonPartially comparable-8.89 ptobs. 12 Sept 2026artificialanalysis.aiT2History
337granite-4.1-8bOpen weightsIBM · Granite 4.143.3%IndependentreasoningoffPartially comparable-8.89 ptobs. 12 Sept 2026artificialanalysis.aiT2History
337nova-liteClosedAmazon Web Services · Nova43.3%IndependentreasoningoffPartially comparable-8.89 ptobs. 12 Sept 2026artificialanalysis.aiT2History
340llama-3-2-instruct-90b-visionOpen weightsMeta AI · Llama 3.243.2%IndependentreasoningoffPartially comparable-8.99 ptobs. 12 Sept 2026artificialanalysis.aiT2History
341Gemma 3 27BOpen weightsGoogle · Gemma 342.8%IndependentreasoningoffPartially comparable-9.39 ptobs. 12 Sept 2026artificialanalysis.aiT2History
342jamba-1-5-largeOpen weightsAI21 Labs · Jamba 1.542.7%IndependentreasoningoffPartially comparable-9.49 ptobs. 12 Sept 2026artificialanalysis.aiT2History
343gpt-4o-miniClosedOpenAI · GPT 442.6%IndependentreasoningoffPartially comparable-9.59 ptobs. 12 Sept 2026artificialanalysis.aiT2History
344Molmo2-8BOpen weightsAllen Institute for AI42.5%IndependentreasoningoffPartially comparable-9.69 ptobs. 12 Sept 2026artificialanalysis.aiT2History
345Mistral SabaClosedMistral AI · Mistral42.4%IndependentreasoningoffPartially comparable-9.80 ptobs. 12 Sept 2026artificialanalysis.aiT2History
346deepseek-v2-5Open weightsDeepSeek · DeepSeek42.3%IndependentreasoningoffPartially comparable-9.90 ptobs. 12 Sept 2026artificialanalysis.aiT2History
347Qwen2.5 Coder 32B InstructOpen weightsQwen · Qwen2.541.7%IndependentreasoningoffPartially comparable-10.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
348granite-4-0-h-smallOpen weightsIBM · Granite 4.041.6%IndependentreasoningoffPartially comparable-10.6 ptobs. 12 Sept 2026artificialanalysis.aiT2History
348sarvam-m-reasoningOpen weightsSarvam41.6%IndependentreasoningonPartially comparable-10.6 ptobs. 12 Sept 2026artificialanalysis.aiT2History
350devstral-smallOpen weightsMistral AI · Devstral41.4%IndependentreasoningoffPartially comparable-10.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
351Kimi-Linear-48B-A3B-InstructOpen weightsMoonshot AI · Kimi41.2%IndependentreasoningoffPartially comparable-11.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
352qwen-turboClosedAlibaba Group · Qwen41.0%IndependentreasoningoffPartially comparable-11.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
353Llama-3.1-70BOpen weightsMeta AI · Llama 3.140.9%IndependentreasoningoffPartially comparable-11.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
354Claude Haiku 3.5ClosedAnthropic · Claude40.8%IndependentreasoningoffPartially comparable-11.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
354llama-3-1-nemotron-nano-4b-reasoningOpen weightsNVIDIA · Llama 3.140.8%IndependentreasoningonPartially comparable-11.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
356R1 Distill Llama 70BOpen weightsDeepSeek · Llama40.2%IndependentreasoningonPartially comparable-12.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
357Hermes 3 70B InstructOpen weightsNous Research · Hermes 340.1%IndependentreasoningoffPartially comparable-12.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
358Olmo-3-7B-InstructOpen weightsAllen Institute for AI · OLMo 340%IndependentreasoningoffPartially comparable-12.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
358claude-3-sonnetClosedAnthropic · Claude 340%IndependentreasoningoffPartially comparable-12.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
360jamba-1-7-largeOpen weightsAI21 Labs · Jamba 1.739.0%IndependentreasoningoffPartially comparable-13.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
361jamba-1-6-largeOpen weightsAI21 Labs · Jamba 1.638.7%IndependentreasoningoffPartially comparable-13.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
362deephermes-3-mistral-24b-previewOpen weightsNous Research · Mistral38.2%IndependentreasoningoffPartially comparable-14.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
363mistral-smallOpen weightsMistral AI · Mistral38.1%IndependentreasoningoffPartially comparable-14.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
364llama-3-instruct-70bOpen weightsMeta AI · Llama 337.9%IndependentreasoningoffPartially comparable-14.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
365Claude 3 HaikuClosedAnthropic · Claude37.4%IndependentreasoningoffPartially comparable-14.9 ptobs. 12 Sept 2026artificialanalysis.aiT2History
366gemini-1-5-pro-may-2024ClosedGoogle · Gemini 1.537.1%IndependentreasoningoffPartially comparable-15.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
366qwen2-72b-instructOpen weightsAlibaba Group · Qwen237.1%IndependentreasoningoffPartially comparable-15.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
368gemini-1-5-flash-8bClosedGoogle · Gemini 1.535.9%IndependentreasoningoffPartially comparable-16.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
369Ministral 3 3BOpen weightsMistral AI · Ministral 335.8%IndependentreasoningoffPartially comparable-16.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
369nova-microClosedAmazon Web Services · Nova35.8%IndependentreasoningoffPartially comparable-16.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
371qwen3-1.7b-instructOpen weightsAlibaba Group · Qwen3.1 · best of 2 rows35.6%IndependentreasoningonPartially comparable-16.7 ptobs. 12 Sept 2026artificialanalysis.aiT2History
372Mistral LargeClosedMistral AI · Mistral35.0%IndependentreasoningoffPartially comparable-17.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
373Gemma 3 12BOpen weightsGoogle · Gemma 335.0%IndependentreasoningoffPartially comparable-17.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
373gpt-4ClosedOpenAI · GPT 435.0%IndependentreasoningoffPartially comparable-17.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
373mistral-mediumClosedMistral AI · Mistral35.0%IndependentreasoningoffPartially comparable-17.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
376claude-2ClosedAnthropic · Claude 234.4%IndependentreasoningoffPartially comparable-17.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
376lfm2-8b-a1bOpen weightsLiquid AI · LFM234.4%IndependentreasoningoffPartially comparable-17.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
378Qwen2.5-Coder-7BOpen weightsQwen · Qwen2.533.9%IndependentreasoningoffPartially comparable-18.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
378lfm2-5-1-2b-thinkingOpen weightsLiquid AI · LFM2.533.9%IndependentreasoningonPartially comparable-18.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
380granite-3-3-8b-instructOpen weightsIBM · Granite 3.333.8%IndependentreasoningoffPartially comparable-18.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
381Granite 4.0 MicroOpen weightsIBM · Granite 4.033.6%IndependentreasoningoffPartially comparable-18.6 ptobs. 12 Sept 2026artificialanalysis.aiT2History
382jamba-reasoning-3bOpen weightsAI21 Labs · Jamba33.3%IndependentreasoningonPartially comparable-18.9 ptobs. 12 Sept 2026artificialanalysis.aiT2History
383Mixtral 8x22BOpen weightsMistral AI · Mixtral 833.2%IndependentreasoningoffPartially comparable-19.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
384dbrxOpen weightsDatabricks33.1%IndependentreasoningoffPartially comparable-19.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
384phi-4-miniOpen weightsMicrosoft · Phi433.1%IndependentreasoningoffPartially comparable-19.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
386claude-instantClosedAnthropic · Claude33.0%IndependentreasoningoffPartially comparable-19.2 ptobs. 12 Sept 2026artificialanalysis.aiT2History
387olmo-2-32bOpen weightsAllen Institute for AI · OLMo 232.8%IndependentreasoningoffPartially comparable-19.4 ptobs. 12 Sept 2026artificialanalysis.aiT2History
388lfm-40bClosedLiquid AI · LFM32.7%IndependentreasoningoffPartially comparable-19.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
388llama-2-chat-70bOpen weightsMeta AI · Llama 232.7%IndependentreasoningoffPartially comparable-19.5 ptobs. 12 Sept 2026artificialanalysis.aiT2History
390LFM2.5-1.2B-InstructOpen weightsLiquid AI · LFM2.532.6%IndependentreasoningoffPartially comparable-19.6 ptobs. 12 Sept 2026artificialanalysis.aiT2History
391gemini-1-5-flash-may-2024ClosedGoogle · Gemini 1.532.4%IndependentreasoningoffPartially comparable-19.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
392command-r-plus-04-2024Open weightsCohere · Command32.3%IndependentreasoningoffPartially comparable-19.9 ptobs. 12 Sept 2026artificialanalysis.aiT2History
393jamba-1-7-miniOpen weightsAI21 Labs · Jamba 1.732.2%IndependentreasoningoffPartially comparable-20.0 ptobs. 12 Sept 2026artificialanalysis.aiT2History
394llama-2-chat-13bOpen weightsMeta AI · Llama 232.1%IndependentreasoningoffPartially comparable-20.1 ptobs. 12 Sept 2026artificialanalysis.aiT2History
395claude-21ClosedAnthropic · Claude 2131.9%IndependentreasoningoffPartially comparable-20.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
395deepseek-coder-v2-liteOpen weightsDeepSeek · DeepSeek31.9%IndependentreasoningoffPartially comparable-20.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
395phi-3-miniOpen weightsMicrosoft · Phi331.9%IndependentreasoningoffPartially comparable-20.3 ptobs. 12 Sept 2026artificialanalysis.aiT2History
398phi-4-multimodalOpen weightsMicrosoft · Phi431.5%IndependentreasoningoffPartially comparable-20.7 ptobs. 12 Sept 2026artificialanalysis.aiT2History
399granite-4.1-3bOpen weightsIBM · Granite 4.131.4%IndependentreasoningoffPartially comparable-20.8 ptobs. 12 Sept 2026artificialanalysis.aiT2History
400lfm2-2-6bOpen weightsLiquid AI · LFM2.230.6%IndependentreasoningoffPartially comparable-21.6 ptobs. 12 Sept 2026artificialanalysis.aiT2History

One row per canonical model — its best current row inside this comparability group (effort variants are folded into the model). Bars are relative to the page's best score. “vs leader” reads comparability: partially comparable = same task, conditions differ (reasoning effort, temperature, judge). Rules →