Benchmarks
SimpleQA Verified
Models scored
68
Best score
0.77
Metric
mean_score
SimpleQA Verified is an AI evaluation tracked by Epoch AI, with 68 scored model versions on record. Epoch AI runs this evaluation directly, so the scores are reproducible against their published logs.
Scored models span October 2024 to July 2026. The best score recorded is 0.77, measured as mean_score. Models come from Anthropic, Moonshot, xAI, OpenAI, Z.ai (Zhipu AI), DeepSeek, Alibaba, Google and others.
Full record
- Score metric
- mean_score
- Models scored
- 68
- Best score recorded
- 0.77
- Earliest model scored
- Oct 22, 2024
- Most recent model scored
- Jul 24, 2026
- Third-party reported
- No
Leaderboard
| 01 | gemini-3.1-pro-preview | Google DeepMind | 0.77 |
| 02 | gemini-3-pro-preview | Google DeepMind | 0.73 |
| 03 | gpt-5.6-sol_max | OpenAI | 0.72 |
| 04 | gemini-3.5-flash_high | 0.68 | |
| 05 | claude-fable-5_xhigh | Anthropic | 0.68 |
| 06 | qwen3-max-2025-09-23 | Alibaba | 0.67 |
| 07 | gemini-3-flash-preview | Google DeepMind | 0.67 |
| 08 | muse-spark | Meta AI | 0.66 |
| 09 | gpt-5.5-pro-pre-release_xhigh | OpenAI | 0.65 |
| 10 | gpt-5.5-pre-release_xhigh | OpenAI | 0.63 |
| 11 | qwen3.7-max | Alibaba | 0.59 |
| 12 | deepseek-v4-pro_max | DeepSeek | 0.57 |
| 13 | qwen3.6-max-preview | Alibaba | 0.57 |
| 14 | claude-opus-5_max | Anthropic | 0.57 |
| 15 | gemini-2.5-pro | Google DeepMind | 0.56 |
| 16 | grok-4.5_high | xAI | 0.54 |
| 17 | o3-2025-04-16_high | OpenAI | 0.53 |
| 18 | claude-opus-4-7_xhigh | Anthropic | 0.51 |
| 19 | gpt-5-2025-08-07_high | OpenAI | 0.51 |
| 20 | Qwen3-235B-A22B-Thinking-2507 | Alibaba | 0.5 |
| 21 | qwen3.6-plus | Alibaba | 0.49 |
| 22 | gpt-5.1-2025-11-13_high | OpenAI | 0.49 |
| 23 | grok-4-0709 | xAI | 0.48 |
| 24 | gpt-5.4-pro-2026-03-05_xhigh | OpenAI | 0.48 |
| 25 | claude-opus-4-6_32K | Anthropic | 0.46 |
| 26 | gpt-5.4-2026-03-05_xhigh | OpenAI | 0.45 |
| 27 | claude-opus-4-6 | Anthropic | 0.43 |
| 28 | gpt-5.6-terra_max | OpenAI | 0.43 |
| 29 | kimi-k3_max | Moonshot | 0.43 |
| 30 | claude-opus-4-5-20251101_32K | Anthropic | 0.42 |
| 31 | gpt-5.6-luna_max | OpenAI | 0.42 |
| 32 | claude-opus-4-6_max | Anthropic | 0.41 |
| 33 | claude-opus-4-8_max | Anthropic | 0.4 |
| 34 | kimi-k2.7-code | Moonshot | 0.39 |
| 35 | gpt-5.2-2025-12-11_xhigh | OpenAI | 0.39 |
| 36 | kimi-k2.6 | Moonshot | 0.39 |
| 37 | gpt-5.2-2025-12-11_high | OpenAI | 0.38 |
| 38 | glm-5.2_max | Z.ai (Zhipu AI) | 0.38 |
| 39 | grok-4.3_high | xAI | 0.38 |
| 40 | glm-5.1 | Z.ai (Zhipu AI) | 0.37 |
| 41 | gpt-5.2-2025-12-11_medium | OpenAI | 0.35 |
| 42 | grok-4.20-0309-reasoning | xAI | 0.35 |
| 43 | claude-opus-4-1-20250805_27K | Anthropic | 0.35 |
| 44 | gpt-5.2-2025-12-11_low | OpenAI | 0.35 |
| 45 | fireworks/kimi-k2p5 | Moonshot | 0.34 |
| 46 | kimi-k2-thinking-turbo | Moonshot | 0.32 |
| 47 | glm-4.7 | Z.ai (Zhipu AI) | 0.32 |
| 48 | claude-sonnet-4-6_32K | Anthropic | 0.29 |
| 49 | gpt-5.4-mini-2026-03-17_high | OpenAI | 0.29 |
| 50 | deepseek-reasoner | DeepSeek | 0.28 |
| 51 | DeepSeek-R1-0528 | DeepSeek | 0.27 |
| 52 | qwen3.5-plus | Alibaba | 0.26 |
| 53 | claude-sonnet-5_xhigh | Anthropic | 0.25 |
| 54 | o4-mini-2025-04-16_high | OpenAI | 0.24 |
| 55 | claude-sonnet-4-5-20250929_59K | Anthropic | 0.24 |
| 56 | claude-sonnet-5_max | Anthropic | 0.22 |
| 57 | o4-mini-2025-04-16_low | OpenAI | 0.22 |
| 58 | qwen3.6-flash | Alibaba | 0.21 |
| 59 | grok-3-mini-beta_high | xAI | 0.21 |
| 60 | gpt-5-mini-2025-08-07_high | OpenAI | 0.21 |
More benchmarks
SourceEpoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved 2026-07-29 from https://epoch.ai/benchmarks. Licensed under CC BY 4.0.
← All benchmarks