Skip to main content
Watch: Grok Bot Built My AI Video Arena While I Tested 8 Models

Benchmark leaderboard - 20 entries

GPQA Diamond leaderboard

GPQA is a dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry, and GPQA Diamond is its 198-question subset where both expert validators answered correctly and at most one of three non-experts did. As of November 7, 2026, GPT-6 Astra is listed first on GPQA Diamond with a vendor-reported 96.0%. Every number here is reported by the model's own vendor under its own settings, so the order is not a controlled comparison.

Last verified from 8 sources. Read the caveats

GPQA Diamond

20 entries, in the board's order

GPQA Diamond entries. Rows are in the source's own order; select a column header to sort.
1GPT-6 Astra

OpenAI research environment or API; 'Evaluation scores are the maximum at any effort.'

Vendor-reported

openai.com

96.0%
2GPT-5.6 Sol

OpenAI GPT-5.6 launch eval table (same value repeated in the GPT-6 Astra table)

Vendor-reported

openai.com

94.6%
3Claude Mythos Preview

Anthropic system card: 'averaged over 5 trials'

Vendor-reported

www-cdn.anthropic.com

94.55%
4Gemini 3.1 Pro

Gemini 3.1 Pro Thinking (High), No tools

Vendor-reported

deepmind.google

94.3%
5Claude Opus 4.7

Anthropic system card: 'averaged over 10 trials'

Vendor-reported

www-cdn.anthropic.com

94.2%
6Claude Mythos 5

Claude Fable 5 & Claude Mythos 5 System Card section 8.8: 'averaged over 5 trials'; Anthropic notes it considers GPQA Diamond saturated and plans to stop reporting it (same 94.1% shown for Claude Mythos 5 in OpenAI's GPT-5.6 table)

Vendor-reported

www-cdn.anthropic.com

94.1%
7GPT-5.5

'Evals of GPT were run with reasoning effort set to xhigh' in a research environment

Vendor-reported

openai.com

93.6%
8Claude Opus 4.8

Anthropic system card: 'averaged over 25 trials'

Vendor-reported

www-cdn.anthropic.com

93.6%
9GPT-5.6 Terra

OpenAI GPT-5.6 launch eval table

Vendor-reported

openai.com

92.9%
10Qwen3.8-Max

Qwen3.8-Max Full Benchmark Table; the post says 2.4T parameters (95B active), with open weights releasing next week

Vendor-reported

qwen.ai

92.6
11DeepSeek-V4-Pro

GPQA Diamond (Pass@1), 'Comparison with frontier models (Max reasoning effort)' table in the DeepSeek-V4.1-Flash model card

Vendor-reported

huggingface.co

92.4
12GPT-5.6 Luna

OpenAI GPT-5.6 launch eval table

Vendor-reported

openai.com

92.3%
13Gemini 3 Pro

Gemini 3 launch post: 'GPQA Diamond (91.9%)'; the Gemini 3.1 Pro model card lists Gemini 3 Pro Thinking (High), No tools at 91.9%

Vendor-reported

blog.google

91.9%
14Qwen3.8-Flash-Next

Qwen3.8-Flash-Next blog Performance table (Scientific reasoning)

Vendor-reported

qwen.ai

91.7
15GLM-5.2

Z.ai Full Benchmark Table; reasoning tasks use temperature=1.0, top_p=0.95, max generation length 163,840 tokens; MIT license, weights on Hugging Face

Vendor-reported

z.ai

91.2
16DeepSeek-V4.1-Flash

GPQA Diamond (Pass@1), 'Comparison with frontier models (Max reasoning effort)' table; instruct results use reasoning_effort=100, temperature=1.0, top_p=0.95; MIT-licensed weights

Vendor-reported

huggingface.co

90.9
17Gemini 3 Flash

Gemini 3 Flash launch post

Vendor-reported

blog.google

90.4%
18Qwen3.8-27B

Qwen3.8-27B model card benchmark table (Scientific reasoning)

Vendor-reported

huggingface.co

89.2
19Muse Spark Open (816B-A42B)

Muse Spark Open (xhigh): 'xhigh reasoning effort, temperature = 1.0, top_p=1.0, top_k=disabled across benchmarks'; open weights

Vendor-reported

huggingface.co

89.0
20Gemma 4 31B

Gemma 4 model card benchmark results (instruction-tuned models)

Vendor-reported

ai.google.dev

84.3%

About this board

  • Rows marked vendor-reported come from the model maker's own model card or launch post, run under its own settings. Read the setting under each model before comparing two rows.
  • All scores are vendor-reported from model cards, system cards and release posts; third-party aggregator leaderboards were excluded. The benchmark paper is arXiv:2311.12022.
  • The Claude Fable 5 & Claude Mythos 5 System Card (June 9, 2026) says Anthropic considers GPQA Diamond a saturated evaluation and plans to stop reporting the performance of future models on it.
  • OpenAI's GPT-6 Astra table lists Claude Fable 5.1 at 93.7%, Claude Fable 5 at 92.6%, Claude Opus 5 at 93.7% and Gemini 3.8 Flash at 95.3%. Those are OpenAI's figures, not the model makers' own, so they are not listed here.
  • GLM-5.3: Meta's Muse Spark Open card lists GLM 5.3 (max) at 91.7 and DeepSeek's V4.1-Flash card lists GLM-5.3 at 88.1. Neither is Z.ai's own figure, so neither is listed here.
  • MiniMax M3: Z.ai's GLM-5.2 table lists it at 93.0. That is Z.ai's figure, not MiniMax's, so it is not listed here.
  • No release date was found on the pages read for GPT-6 Astra (the post carries update notes dated September 22 and 29, 2026), Claude Opus 4.7, DeepSeek-V4.1-Flash and DeepSeek-V4-Pro, Qwen3.8-27B (its citation gives the month only) and the Gemma 4 model card (last updated 2026-07-30), so those dates are left blank.

FAQ

What does GPQA Diamond measure?

GPQA is a dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry, and GPQA Diamond is its 198-question subset where both expert validators answered correctly and at most one of three non-experts did.

Which model leads GPQA Diamond?

As of November 7, 2026, GPT-6 Astra is listed first on GPQA Diamond with a vendor-reported 96.0%. Vendors run the test under their own settings, so the list order is not a controlled comparison.

Where do these GPQA Diamond scores come from?

20 are vendor-reported, taken from the model maker's own model card or launch post. Every entry links to its source, which was read on November 7, 2026, and lists the setting it was run under.

Sources

Last verified . Each row links to the page its score was copied from.

Newsletter

Get new benchmark results as they land

One email per week. New model releases, the leaderboard moves that matter and what they mean for what you build.