Skip to content
Model Menu
Models
Compare
Leaderboard
Benchmarks
⌘K
Top
Chat
Coding
Agents
Writing
Vision
Image
Video
Speech
Embeddings
Decision
Music
Filters
Best for Chat & Knowledge
All models
2314
Chat & Knowledge
563
Coding
383
Agents & Tool Use
543
Writing & Language
361
Vision & Documents
397
Image Generation & Editing
184
Video Generation
148
Speech & Voice
358
Embeddings & Retrieval
688
Decision models
118
Music & Sound
29
Humanity's Last Exam
Arena Text · English
AA Omniscience Index
SimpleQA Verified v1
CritPt
AA Intelligence Index 4.3.2
FrontierMath Erdos
All benchmarks
148
Chat & Knowledge benchmarks
148
×
All
148
Overall
1
Knowledge
35
Reasoning
9
Math
51
Science
9
Health & law
5
Documents
2
Benchmark
By
Leader
Models
Overall
1
AA Intelligence Index
4.3.2
Artificial Analysis combines tests of knowledge, reasoning, coding and tool use into one score
AA
Claude Opus 5.5
57.6
336
Knowledge
35
Arena Text
English
Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,526
205
+24 versions & slices
instruction following
Human pairwise preferences in the stated text vote pool
Arena
Claude Opus 5.5
1,539
205
non-English
Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,519
205
Russian
Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,537
203
Chinese
Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,600
198
overall · October 22, 2026
Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,526
198
overall
Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,524
196
overall · October 15, 2026
Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,532
188
Spanish
Human pairwise preferences in the stated text vote pool
Arena
Claude Opus 5
1,522
168
German
Human pairwise preferences in the stated text vote pool
Arena
Claude Opus 5
1,530
167
French
Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,543
164
Korean
Human pairwise preferences in the stated text vote pool
Arena
Claude Opus 5
1,518
156
Japanese
Human pairwise preferences in the stated text vote pool
Arena
Claude Fable 5.1
1,560
152
Polish
Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,530
142
Chinese · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,477
1
English · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,441
1
French · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,445
1
German · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,466
1
instruction following · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,414
1
Japanese · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,425
1
Korean · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,418
1
non-English · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,438
1
Polish · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,468
1
Russian · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,454
1
Spanish · minimal effort
Human pairwise preferences in the stated text vote pool
Arena
Gemini 3 Flash Preview
1,427
1
AA Omniscience Index
Scores factual knowledge while penalizing incorrect answers to encourage admitting uncertainty
AA
Claude Opus 5.5
46.4
320
SimpleQA Verified
v1
Accuracy on short factual questions with verified answers, answered without web access
Gemini 3.1 Pro Preview
77.5%
84
+1 versions & slices
v1 · October 2026 run
Accuracy on short factual questions with verified answers, answered without web access
Gemma 4 31B
10.7%
1
AA Omniscience
Accuracy
Measures correct answers on the AA Omniscience factual knowledge test
AA
Claude Fable 5.1
67.2%
320
+1 versions & slices
Hallucination Rate
Measures how often attempted answers are incorrect on the AA Omniscience factual knowledge test
AA
O
MiniCPM5 1B
0.9%
320
IFBench (instructions)
Checks whether the model follows precise formatting and content instructions
AA
Grok 4.3
83.3%
245
Mystery Game Puzzles
Models choose the best move in puzzle positions from an undisclosed game
Epoch
GPT-6 Astra
84%
65
+1 versions & slices
August 2026 run
Models choose the best move in puzzle positions from an undisclosed game
Epoch
Gemini 3.1 Pro Preview
29%
1
EQ-Bench
3
Judge-rated responses to social and emotionally nuanced scenarios, scored through the source pairwise ranking
EQ-Bench
Claude Fable 5
2,096
53
+1 versions & slices
4
Active emotional and social intelligence in multi-turn conversations with 120 simulated personas
EQ-Bench
Kimi K3
1,339
1
Reasoning
9
ARC-AGI-2
semi-private
Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
GPT-6 Astra
95%
69
+3 versions & slices
public evaluation
Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
Claude Fable 5.1
99.2%
66
public evaluation · chain of thought
Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
R1 0528
0.3%
1
semi-private · chain of thought
Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
R1 0528
1.1%
1
Chess Puzzles
Models choose the best next move from a novel chess position
Epoch
GPT-6 Astra
74%
69
ARC-AGI-1
semi-private
Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
Claude Fable 5
98.5%
67
+2 versions & slices
public evaluation
Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
Gemini 4 Argon
99.5%
64
semi-private · chain of thought
Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
R1 0528
21.2%
1
ARC-AGI-3
semi-private
Measures interactive game solving through relative human action efficiency
ARC
GPT-6 Astra
62.7%
19
Math
49
AIME
2025 · AA archived
AA evaluates the 30 integer-answer problems from the 2025 AIME mathematics competition
AA
GPT-5.2
99%
139
+1 versions & slices
2025
Reported by the lab with its own setup
Lab
DeepSeek V3.2 Speciale
96
5
FrontierMath Tiers 1–3 (v2)
Models solve expert-written advanced mathematics problems on the named tier and edition
Epoch
GPT-6 Astra
93.7%
70
FrontierMath Tier 4 (v2)
Models solve expert-written advanced mathematics problems on the named tier and edition
Epoch
GPT-6.1 Sol
100%
55
FrontierMath
Models solve expert-written advanced mathematics problems on the named tier and edition
Epoch
GPT-5.4 Pro (2026-03-05)
50%
40
MATH Level
5
Models solve competition mathematics problems from the hardest MATH difficulty level
Epoch
GPT-5 (2025-08-07)
98.1%
35
MathArena
Apex
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 4.8
81.3%
34
+40 versions & slices
AIME 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
100%
30
Apex Shortlist
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
98.4%
30
HMMT February 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
100%
30
AIME 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 4.8
100%
24
HMMT February 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
98.5%
24
ArXivMath · June 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6 Astra
94.4%
24
BrokenArXiv · June 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 5.5
100%
24
BRUMO 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Gemini 3 Flash Preview
100%
24
SMT 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
96%
24
CMIMC 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
95.6%
22
ArXivMath · February 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.4 Pro
75.8%
20
ArXivMath · May 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6 Astra
95%
19
ArXivMath · January 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.4
76.1%
18
BrokenArXiv · May 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 5.5
95%
18
ArXivMath · April 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6 Astra
90.8%
17
Kangaroo 2025 1-2
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
95.8%
17
Kangaroo 2025 11-12
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 4.8
100%
17
Kangaroo 2025 3-4
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
89.6%
17
Kangaroo 2025 5-6
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
90%
17
Kangaroo 2025 7-8
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 4.8
96.7%
16
Kangaroo 2025 9-10
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Gemini 3.1 Pro Preview
100%
16
BrokenArXiv · April 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6 Astra
97.5%
15
BrokenArXiv · February 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
68.2%
15
ArXivMath · August 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6.1 Sol
96.5%
14
ArXivMath · March 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
77.5%
14
HMMT November 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
99.2%
14
ArXivMath · December 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Gemini 3.1 Pro Preview
66.2%
13
BrokenArXiv · August 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6.1 Sol
86.3%
13
BrokenArXiv · March 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
73.7%
13
Project Euler
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Gemini 3.1 Pro Preview
89%
11
ArXivMath · September 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6.1 Sol
91.5%
9
BrokenArXiv · September 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6.1 Sol
82.7%
9
ArXivLean · June 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6 Astra
65.2%
9
USAMO 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
98.2%
8
ArXivLean · September 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 5.5
47.2%
6
ArXivLean · March 2026
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.4
17.1%
5
IMO 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5
38.1%
4
Putnam 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5 Pro
77.5%
3
USAMO 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
R1 0528
30.1%
3
Miklós Schweitzer 2025
Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5 Pro
90%
1
FrontierMath Tier
4
Models solve expert-written advanced mathematics problems on the named tier and edition
Epoch
Claude Opus 4.8
31.3%
33
FrontierMath Erdos
Models solve expert-written advanced mathematics problems on the named tier and edition
Epoch
GPT-6.1 Sol
4.4%
13
Science
6
Humanity's Last Exam
Very hard expert questions across many fields, written to stump today’s models
AA
Claude Opus 5.5
61.4%
336
CritPt (physics)
Research-level physics problems that need many careful reasoning steps
AA
Muse Wonder Full
32.9%
323
MMLU-Pro
official board
Graduate-level multiple-choice knowledge and reasoning across 14 subjects, including science, mathematics, law and health
Gemini 3.1 Pro
91.2%
32
+2 versions & slices
official board
Reported by the lab with its own setup
Lab
Claude Opus 4.6
89.1
63
MMLU-Pro
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
85
1
Vals Science Index
Scientific problem solving across the index’s component evaluations
Vals
GPT-6 Astra
65.1%
19
Health & law
5
MLCR-AA
Models synthesize long medical records; the headline credits concise answers judged both accurate and complete
AA
Claude Sonnet 5.5
41.7%
103
Vals LegalBench
Legal reasoning and legal-language understanding on LegalBench
Vals
Claude Fable 5
88.6%
89
Vals MedScribe
Accuracy of clinical notes produced from consultation transcripts
Vals
Claude Opus 5.5
91.4%
80
Vals MedCode
Medical coding accuracy on patient encounters
Vals
Claude Opus 5
63.6%
78
Vals Legal Research Bench
Grounded legal research; a task passes only if all criteria pass
Vals
Claude Fable 5.1
55.3%
73
Documents
2
AA-LCR (long context)
1.1
Questions that need reading and connecting facts across very long documents (around 100K tokens)
AA
Kimi K3
88.7%
314
GDP.pdf
AA all-pass
Models reason over professional PDF documents; an attempt passes only when every atomic criterion passes
Muse Wonder Full
32.6%
135
Reported by labs
36
SimpleQA-Verified
Reported by the lab with its own setup
Lab
Gemini 3.1 Pro
75.6
6
Chinese-SimpleQA
Reported by the lab with its own setup
Lab
Gemini 3.1 Pro
85.9
6
GPQA Diamond pass@1
Reported by the lab with its own setup
Lab
o1 1217
75.7
12
MMLU-Pro EM
Reported by the lab with its own setup
Lab
Gemini 3.1 Pro
91
6
MMLU pass@1
Reported by the lab with its own setup
Lab
o1 1217
91.8
4
HealthBench Professional length-adjusted
Reported by the lab with its own setup
Lab
GPT-6 Astra
70.3
24
AIME 2024 pass@1
Reported by the lab with its own setup
Lab
DeepSeek R1
79.8
12
MATH-500 pass@1
Reported by the lab with its own setup
Lab
DeepSeek R1
97.3
12
IMOAnswerBench
Reported by the lab with its own setup
Lab
GPT-5.4
91.4
9
HealthBench length-adjusted
Reported by the lab with its own setup
Lab
GPT-6.1 Sol
58.5
8
HealthBench Hard length-adjusted
Reported by the lab with its own setup
Lab
GPT-6 Astra
36.6
8
HealthBench Consensus length-adjusted
Reported by the lab with its own setup
Lab
GPT-6 Sol
96.2
8
AIME 2024 cons@64
Reported by the lab with its own setup
Lab
DeepSeek R1 Distill Llama 70B
86.7
8
AA Cyber Index successes
Reported by the lab with its own setup
Lab
Mistral Large 4
50
7
HMMT February
2026
Reported by the lab with its own setup
Lab
GPT-5.4
97.7
6
+1 versions & slices
2025
Reported by the lab with its own setup
Lab
DeepSeek V3.2 Speciale
99.2
3
Apex
Reported by the lab with its own setup
Lab
Gemini 3.1 Pro
60.9
6
Apex Shortlist
Reported by the lab with its own setup
Lab
DeepSeek V4 Pro 0813
90.2
6
GDPval-AA Elo
Reported by the lab with its own setup
Lab
GPT-5.4
1,674
6
ExploitGym
Reported by the lab with its own setup
Lab
GPT-5.6 Sol
33.7
5
HLE full
Reported by the lab with its own setup
Lab
Claude Opus 5
56.3
4
MRCR 1M MMR
Reported by the lab with its own setup
Lab
Claude Opus 4.6
92.9
3
CorpusQA 1M
Reported by the lab with its own setup
Lab
Claude Opus 4.6
71.7
3
HMMT 2025 chart edition unstated
Reported by the lab with its own setup
Lab
DeepSeek V3.2 Speciale
99.2
3
HLE text-only
Reported by the lab with its own setup
Lab
DeepSeek V4 Pro 0813
42.7
3
MathArena Apex
Reported by the lab with its own setup
Lab
DeepSeek V4.1 Flash 1017
65.6
3
SEC-Bench Pro
Reported by the lab with its own setup
Lab
GPT-5.6 Sol
74.3
3
HMMT November
2025
Reported by the lab with its own setup
Lab
DeepSeek V3.2 Speciale
94.4
3
Internal hard web search eval
Reported by the lab with its own setup
Lab
ChatGPT GPT-6
53.8
2
Humanity’s Last Exam
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
21.7
1
HMMT
2025
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
86.1
1
STEM weighted win rate vs GLM-5.3
Reported by the lab with its own setup
Lab
Mistral Large 4
69
1
Human preference win rate vs GLM-5.2
Reported by the lab with its own setup
Lab
Mistral Large 4
79.5
1
Human preference win rate vs GLM-5.3
Reported by the lab with its own setup
Lab
Mistral Large 4
69.2
1
Human preference win rate vs Kimi K3
Reported by the lab with its own setup
Lab
Mistral Large 4
69.2
1
Human preference win rate vs Claude Opus
5
Reported by the lab with its own setup
Lab
Mistral Large 4
38.5
1
Legacy · saturated or no longer reported
5
GPQA Diamond
Graduate-level biology, chemistry and physics questions that can’t be solved by a quick web search
GPT-6 Astra
96.3%
312
+2 versions & slices
Epoch
Models answer graduate-level science multiple-choice questions
Epoch
Gemini 4 Argon
96.4%
134
January 2025 run
Models answer graduate-level science multiple-choice questions
Epoch
DeepSeek V3
56.5%
1
OTIS Mock AIME 2024
2025
Models solve the stated OTIS mock AIME mathematics problems
Epoch
Claude Fable 5
100%
131
+1 versions & slices
2025 · February 2025 run
Models solve the stated OTIS mock AIME mathematics problems
Epoch
DeepSeek V3
15.8%
1
No benchmark matches
Model
FrontierMath Erdos
Per task
Price
Speed
Supports
Context
GPT-6.1 Sol
OpenAI
4.4
max
$0.72
$2
/
$10
69
1.05M
GPT-6 Astra
OpenAI
2.9
max
$3.26
$10
/
$50
66
1.05M
Claude Opus 5.5
Anthropic
2.9
max
$5.98
$4
/
$20
98
1M
Claude Sonnet 5.5
Anthropic
2.9
max
$5.46
$2
/
$10
141
1M
GPT-6 Sol
OpenAI
1.5
max
$1.04
$2
/
$10
127
1.05M
Claude Fable 5
Anthropic
0
max
$8.75
$10
/
$50
67
1M
Claude Fable 5.1
Anthropic
0
max
$7.63
$10
/
$50
70
1M
Claude Opus 5
Anthropic
0
max
$5.86
$5
/
$25
52
1M
Gemini 3.8 Flash
Google
0
high
$3.49
$0.75
/
$3.75
132
1M
Kimi K3
Moonshot AI
Open
0
max
$2.00
$3
/
$15
55
1M
GPT-5.5
OpenAI
0
xhigh
$2.10
$5
/
$30
92
1.05M
GPT-5.6 Sol
OpenAI
0
max
$1.99
$4
/
$20
81
1.05M
Grok 4.7
xAI
0
xhigh
$3.24
$2
/
$6
88
500K
Show 550 not measured on FrontierMath Erdos
