Model Menu
Models
Compare
Leaderboard
Benchmarks
⌘K
Top
Chat
Coding
Agents
Writing
Vision
Image
Video
Speech
Embeddings
Decision
Music
Filters
Best for Chat & Knowledge
All models
2292
Chat & Knowledge
558
Coding
381
Agents & Tool Use
541
Writing & Language
360
Vision & Documents
395
Image Generation & Editing
183
Video Generation
148
Speech & Voice
358
Embeddings & Retrieval
671
Decision models
118
Music & Sound
29
Humanity's Last Exam
Arena Text
AA Omniscience Index
SimpleQA Verified v1
CritPt
AA Intelligence Index 4.3.2
OTIS Mock AIME 2024 2025 (past run)
All benchmarks
143
Chat & Knowledge benchmarks
143
×
All
143
Overall
1
Knowledge
24
Reasoning
9
Math
56
Science
9
Health & law
6
Documents
2
Benchmark
By
Leader
Models
Overall
1
AA Intelligence Index
4.3.2
AA Intelligence Index 4.3.2: Artificial Analysis combines tests of knowledge, reasoning, coding and tool use into one score
AA
Claude Opus 5.5
57.6
334
Knowledge
24
Arena Text
Arena Text · overall: Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,524
196
+13 versions & slices
English
Arena Text · english: Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,538
188
instruction following
Arena Text · instruction following: Human pairwise preferences in the stated text vote pool
Arena
Claude Opus 5.5
1,536
188
non-English
Arena Text · non english: Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,522
188
overall · full cohort
Arena Text · overall · snapshot 2026-10-15 · native board settings: Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,532
188
Russian
Arena Text · russian: Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,534
186
Chinese
Arena Text · chinese: Human pairwise preferences in the stated text vote pool
Arena
Gemini 4 Argon
1,608
181
Spanish
Arena Text · spanish: Human pairwise preferences in the stated text vote pool
Arena
Claude Fable 5.1
1,521
155
German
Arena Text · german: Human pairwise preferences in the stated text vote pool
Arena
Claude Opus 5
1,526
154
French
Arena Text · french: Human pairwise preferences in the stated text vote pool
Arena
Claude Fable 5.1
1,527
149
Korean
Arena Text · korean: Human pairwise preferences in the stated text vote pool
Arena
Claude Fable 5.1
1,521
144
Japanese
Arena Text · japanese: Human pairwise preferences in the stated text vote pool
Arena
Claude Fable 5.1
1,560
138
Polish
Arena Text · polish: Human pairwise preferences in the stated text vote pool
Arena
Claude Fable 5.1
1,524
133
overall · Gemini 1.5 Flash (001) / Gemini 1.5 Pro (001) / Mistral Large 2402
Arena Text · overall · Arena text; source adjustment/filter settings · historical run: Human pairwise preferences in the stated text vote pool
Arena
Mistral Large
1,243
1
AA Omniscience Index
AA Omniscience Index: Scores factual knowledge while penalizing incorrect answers to encourage admitting uncertainty
AA
Claude Opus 5.5
46.4
318
SimpleQA Verified
v1
SimpleQA Verified v1: Accuracy on short factual questions with verified answers, answered without web access
Gemini 3.1 Pro Preview
77.5%
83
+1 versions & slices
v1 · October 2026 run
SimpleQA Verified v1 · Kaggle SimpleQA Verified v1; generation settings not stated · historical run: Accuracy on short factual questions with verified answers, answered without web access
Gemma 4 31B
10.7%
1
AA Omniscience
Accuracy
AA Omniscience · Accuracy: Measures correct answers on the AA Omniscience factual knowledge test
AA
Claude Fable 5.1
67.2%
318
+1 versions & slices
Hallucination Rate
AA Omniscience · Hallucination Rate: Measures how often attempted answers are incorrect on the AA Omniscience factual knowledge test
AA
O
MiniCPM5 1B
0.9%
318
IFBench (instructions)
IFBench (instructions): Checks whether the model follows precise formatting and content instructions
AA
Grok 4.3
83.3%
245
Mystery Game Puzzles
Mystery Game Puzzles: Models choose the best move in puzzle positions from an undisclosed game
Epoch
GPT-6 Astra
84%
64
+1 versions & slices
August 2026 run
Mystery Game Puzzles · Epoch independent run · historical run: Models choose the best move in puzzle positions from an undisclosed game
Epoch
Gemini 3.1 Pro Preview
29%
1
EQ-Bench
3
EQ-Bench 3: Judge-rated responses to social and emotionally nuanced scenarios, scored through the source pairwise ranking
EQ-Bench
Claude Fable 5
2,050
50
+1 versions & slices
4
Active emotional and social intelligence in multi-turn conversations with 120 simulated personas
EQ-Bench
Kimi K3
1,339
1
Reasoning
9
Chess Puzzles
Chess Puzzles: Models choose the best next move from a novel chess position
Epoch
GPT-6 Astra
74%
68
ARC-AGI-2
semi-private
ARC-AGI-2 · semi-private: Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
GPT-6 Astra
95%
66
+3 versions & slices
public evaluation
ARC-AGI-2 · public-eval: Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
Claude Fable 5.1
99.2%
63
public evaluation · chain of thought
ARC-AGI-2 · public-eval · ARC CoT · historical run: Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
R1 0528
0.3%
1
semi-private · chain of thought
ARC-AGI-2 · semi-private · ARC CoT · historical run: Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
R1 0528
1.1%
1
ARC-AGI-1
semi-private
ARC-AGI-1 · semi-private: Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
Claude Fable 5
98.5%
64
+2 versions & slices
public evaluation
ARC-AGI-1 · public-eval: Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
Gemini 4 Argon
99.5%
61
semi-private · chain of thought
ARC-AGI-1 · semi-private · ARC CoT · historical run: Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit
ARC
R1 0528
21.2%
1
ARC-AGI-3
semi-private
ARC-AGI-3 · semi-private: Measures interactive game solving through relative human action efficiency
ARC
GPT-6 Astra
62.7%
18
Math
54
AIME
2025 · AA archived
AIME 2025 · AA archived: AA evaluates the 30 integer-answer problems from the 2025 AIME mathematics competition
AA
GPT-5.2
99%
139
+1 versions & slices
2025
Reported by the lab with its own setup
Lab
DeepSeek V3.2 Speciale
96
5
FrontierMath Tiers 1–3 (v2)
FrontierMath Tiers 1–3 (v2): Models solve expert-written advanced mathematics problems on the named tier and edition
Epoch
GPT-6 Astra
93.7%
69
FrontierMath Tier 4 (v2)
FrontierMath Tier 4 (v2): Models solve expert-written advanced mathematics problems on the named tier and edition
Epoch
GPT-6.1 Sol
100%
54
FrontierMath
FrontierMath: Models solve expert-written advanced mathematics problems on the named tier and edition
Epoch
GPT-5.4 Pro (2026-03-05)
50%
40
MATH Level
5
MATH Level 5: Models solve competition mathematics problems from the hardest MATH difficulty level
Epoch
GPT-5 (2025-08-07)
98.1%
35
MathArena
Apex
MathArena · apex · Apex: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 4.8
81.3%
34
+45 versions & slices
AIME 2025
MathArena · aime · AIME 2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
100%
30
Apex Shortlist
MathArena · apex · Apex Shortlist: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
98.4%
30
HMMT February 2025
MathArena · hmmt · HMMT Feb 2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
100%
30
AIME 2026
MathArena · AIME 2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 4.8
100%
24
HMMT February 2026
MathArena · HMMT February 2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
98.5%
24
ArXivMath · June 2026
MathArena · arxiv · 06/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6 Astra
94.4%
24
BrokenArXiv · June 2026
MathArena · arxiv_false · 06/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 5.5
100%
24
BRUMO 2025
MathArena · brumo · BRUMO 2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Gemini 3 Flash Preview
100%
24
SMT 2025
MathArena · smt · SMT 2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
96%
24
CMIMC 2025
MathArena · cmimc · CMIMC 2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
95.6%
22
ArXivMath · February 2026
MathArena · arxiv · 02/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.4 Pro
75.8%
20
ArXivMath · May 2026
MathArena · arxiv · 05/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6 Astra
95%
19
ArXivMath · January 2026
MathArena · arxiv · 01/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.4
76.1%
18
BrokenArXiv · May 2026
MathArena · arxiv_false · 05/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 5.5
95%
18
ArXivMath · April 2026
MathArena · arxiv · 04/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6 Astra
90.8%
17
Kangaroo 2025 1-2
MathArena · kangaroo · Kangaroo 2025 1-2: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
95.8%
17
Kangaroo 2025 11-12
MathArena · kangaroo · Kangaroo 2025 11-12: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 4.8
100%
17
Kangaroo 2025 3-4
MathArena · kangaroo · Kangaroo 2025 3-4: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
89.6%
17
Kangaroo 2025 5-6
MathArena · kangaroo · Kangaroo 2025 5-6: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
90%
17
Kangaroo 2025 7-8
MathArena · kangaroo · Kangaroo 2025 7-8: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 4.8
96.7%
16
Kangaroo 2025 9-10
MathArena · kangaroo · Kangaroo 2025 9-10: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Gemini 3.1 Pro Preview
100%
16
BrokenArXiv · April 2026
MathArena · arxiv_false · 04/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6 Astra
97.5%
15
BrokenArXiv · February 2026
MathArena · arxiv_false · 02/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
68.2%
15
ArXivMath · March 2026
MathArena · arxiv · 03/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
77.5%
14
HMMT November 2025
MathArena · hmmt · HMMT Nov 2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
99.2%
14
ArXivMath · December 2025
MathArena · arxiv · 12/2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Gemini 3.1 Pro Preview
66.2%
13
BrokenArXiv · March 2026
MathArena · arxiv_false · 03/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
73.7%
13
ArXivMath · August 2026
MathArena · arxiv · 08/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6.1 Sol
96.5%
12
BrokenArXiv · August 2026
MathArena · arxiv_false · 08/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6.1 Sol
86.3%
12
Project Euler
MathArena · euler · Project Euler: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Gemini 3.1 Pro Preview
89%
11
ArXivLean · June 2026
MathArena · arxivlean · 06/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6 Astra
65.2%
9
USAMO 2026
MathArena · usamo · USAMO 2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.5
98.2%
8
ArXivMath · September 2026
MathArena · arxiv · 09/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6.1 Sol
91.5%
7
BrokenArXiv · September 2026
MathArena · arxiv_false · 09/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-6.1 Sol
82.7%
7
ArXivLean · March 2026
MathArena · arxivlean · 03/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.4
17.1%
5
ArXivLean · September 2026
MathArena · arxivlean · 09/2026: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
Claude Opus 5.5
47.2%
5
IMO 2025
MathArena · imo · IMO 2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5
38.1%
4
Putnam 2025
MathArena · putnam · Putnam 2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5 Pro
77.5%
3
USAMO 2025
MathArena · usamo · USAMO 2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
R1 0528
30.1%
3
Miklós Schweitzer 2025
MathArena · miklos · Miklós Schweitzer 2025: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5 Pro
90%
1
AIME 2025 · DeepSeek R1 (original) / o3-mini · low effort
MathArena · aime · AIME 2025 · MathArena competition run · historical run: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
R1 0528
70%
1
BRUMO 2025 · DeepSeek R1 (original)
MathArena · brumo · BRUMO 2025 · MathArena competition run · historical run: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
R1 0528
80.8%
1
HMMT February 2025 · DeepSeek R1 (original) / o3-mini · low effort
MathArena · hmmt · HMMT Feb 2025 · MathArena competition run · historical run: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
R1 0528
41.7%
1
USAMO 2025 · DeepSeek R1 (original)
MathArena · usamo · USAMO 2025 · MathArena competition run · historical run: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
R1 0528
4.8%
1
ArXivMath · January 2026 · GPT-5.2 · low effort
MathArena · arxiv · 01/2026 · MathArena competition run · historical run: Answer accuracy on the named mathematics competition under the recorded effort
MathArena
GPT-5.2
47.9%
1
FrontierMath Tier
4
FrontierMath Tier 4: Models solve expert-written advanced mathematics problems on the named tier and edition
Epoch
Claude Opus 4.8
31.3%
33
FrontierMath Erdos
FrontierMath Erdos: Models solve expert-written advanced mathematics problems on the named tier and edition
Epoch
GPT-6.1 Sol
4.4%
13
Science
6
Humanity's Last Exam
Humanity's Last Exam: Very hard expert questions across many fields, written to stump today’s models
AA
Claude Opus 5.5
61.4%
334
CritPt (physics)
CritPt (physics): Research-level physics problems that need many careful reasoning steps
AA
Muse Wonder Full
32.9%
321
MMLU-Pro
official board
MMLU-Pro · official board: Graduate-level multiple-choice knowledge and reasoning across 14 subjects, including science, mathematics, law and health
Gemini 3.1 Pro
91.2%
32
+2 versions & slices
official board
Reported by the lab with its own setup
Lab
Claude Opus 4.6
89.1
63
MMLU-Pro
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
85
1
Vals Science Index
Vals Science Index: Scientific problem solving across the index’s component evaluations
Vals
GPT-6 Astra
65.1%
18
Health & law
6
Vals LegalBench
Vals LegalBench: Legal reasoning and legal-language understanding on LegalBench
Vals
Claude Fable 5
88.6%
89
+1 versions & slices
DeepSeek V3 March 2025
Vals LegalBench · Vals default evaluation · historical run: Legal reasoning and legal-language understanding on LegalBench
Vals
DeepSeek V3
77.7%
1
Vals MedScribe
Vals MedScribe: Accuracy of clinical notes produced from consultation transcripts
Vals
Claude Opus 5.5
91.4%
80
Vals MedCode
Vals MedCode: Medical coding accuracy on patient encounters
Vals
Claude Opus 5
63.6%
78
Vals Legal Research Bench
Vals Legal Research Bench: Grounded legal research; a task passes only if all criteria pass
Vals
Claude Fable 5.1
55.3%
69
MLCR-AA
MLCR-AA: Models synthesize long medical records; the headline credits concise answers judged both accurate and complete
AA
Claude Sonnet 5.5
75%
64
Documents
2
AA-LCR (long context)
1.1
AA-LCR (long context) 1.1: Questions that need reading and connecting facts across very long documents (around 100K tokens)
AA
Kimi K3
88.7%
273
GDP.pdf
AA all-pass
GDP.pdf · AA all-pass: Models reason over professional PDF documents; an attempt passes only when every atomic criterion passes
Muse Wonder Full
32.6%
133
Reported by labs
36
SimpleQA-Verified
Reported by the lab with its own setup
Lab
Gemini 3.1 Pro
75.6
6
Chinese-SimpleQA
Reported by the lab with its own setup
Lab
Gemini 3.1 Pro
85.9
6
GPQA Diamond pass@1
Reported by the lab with its own setup
Lab
o1 1217
75.7
12
MMLU-Pro EM
Reported by the lab with its own setup
Lab
Gemini 3.1 Pro
91
6
MMLU pass@1
Reported by the lab with its own setup
Lab
o1 1217
91.8
4
HealthBench Professional length-adjusted
Reported by the lab with its own setup
Lab
GPT-6 Astra
70.3
24
AIME 2024 pass@1
Reported by the lab with its own setup
Lab
DeepSeek R1
79.8
12
MATH-500 pass@1
Reported by the lab with its own setup
Lab
DeepSeek R1
97.3
12
IMOAnswerBench
Reported by the lab with its own setup
Lab
GPT-5.4
91.4
9
HealthBench length-adjusted
Reported by the lab with its own setup
Lab
GPT-6.1 Sol
58.5
8
HealthBench Hard length-adjusted
Reported by the lab with its own setup
Lab
GPT-6 Astra
36.6
8
HealthBench Consensus length-adjusted
Reported by the lab with its own setup
Lab
GPT-6 Sol
96.2
8
AIME 2024 cons@64
Reported by the lab with its own setup
Lab
DeepSeek R1 Distill Llama 70B
86.7
8
AA Cyber Index successes
Reported by the lab with its own setup
Lab
Mistral Large 4
50
7
HMMT February
2026
Reported by the lab with its own setup
Lab
GPT-5.4
97.7
6
+1 versions & slices
2025
Reported by the lab with its own setup
Lab
DeepSeek V3.2 Speciale
99.2
3
Apex
Reported by the lab with its own setup
Lab
Gemini 3.1 Pro
60.9
6
Apex Shortlist
Reported by the lab with its own setup
Lab
DeepSeek V4 Pro 0813
90.2
6
GDPval-AA Elo
Reported by the lab with its own setup
Lab
GPT-5.4
1,674
6
ExploitGym
Reported by the lab with its own setup
Lab
GPT-5.6 Sol
33.7
5
HLE full
Reported by the lab with its own setup
Lab
Claude Opus 5
56.3
4
MRCR 1M MMR
Reported by the lab with its own setup
Lab
Claude Opus 4.6
92.9
3
CorpusQA 1M
Reported by the lab with its own setup
Lab
Claude Opus 4.6
71.7
3
HMMT 2025 chart edition unstated
Reported by the lab with its own setup
Lab
DeepSeek V3.2 Speciale
99.2
3
HLE text-only
Reported by the lab with its own setup
Lab
DeepSeek V4 Pro 0813
42.7
3
MathArena Apex
Reported by the lab with its own setup
Lab
DeepSeek V4.1 Flash 1017
65.6
3
SEC-Bench Pro
Reported by the lab with its own setup
Lab
GPT-5.6 Sol
74.3
3
HMMT November
2025
Reported by the lab with its own setup
Lab
DeepSeek V3.2 Speciale
94.4
3
Internal hard web search eval
Reported by the lab with its own setup
Lab
ChatGPT GPT-6
53.8
2
Humanity’s Last Exam
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
21.7
1
HMMT
2025
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
86.1
1
STEM weighted win rate vs GLM-5.3
Reported by the lab with its own setup
Lab
Mistral Large 4
69
1
Human preference win rate vs GLM-5.2
Reported by the lab with its own setup
Lab
Mistral Large 4
79.5
1
Human preference win rate vs GLM-5.3
Reported by the lab with its own setup
Lab
Mistral Large 4
69.2
1
Human preference win rate vs Kimi K3
Reported by the lab with its own setup
Lab
Mistral Large 4
69.2
1
Human preference win rate vs Claude Opus
5
Reported by the lab with its own setup
Lab
Mistral Large 4
38.5
1
Legacy · saturated or no longer reported
5
GPQA Diamond
GPQA Diamond: Graduate-level biology, chemistry and physics questions that can’t be solved by a quick web search
GPT-6 Astra
96.3%
312
+2 versions & slices
Epoch
GPQA Diamond · source setting 2: Models answer graduate-level science multiple-choice questions
Epoch
Gemini 4 Argon
96.4%
133
January 2025 run
GPQA Diamond · Epoch independent run · historical run: Models answer graduate-level science multiple-choice questions
Epoch
DeepSeek V3
56.5%
1
OTIS Mock AIME 2024
2025
OTIS Mock AIME 2024 2025: Models solve the stated OTIS mock AIME mathematics problems
Epoch
Claude Fable 5
100%
130
+1 versions & slices
2025 · February 2025 run
OTIS Mock AIME 2024 2025 · Epoch independent run · historical run: Models solve the stated OTIS mock AIME mathematics problems
Epoch
DeepSeek V3
15.8%
1
No benchmark matches
Model
OTIS Mock AIME 2024 2025 (past run)
Per task
Price
Speed
Supports
Context
DeepSeek V3
DeepSeek
Open
15.8
unstated
—
$0.28
/
$0.42
—
128K
Show 557 not measured on OTIS Mock AIME 2024 2025 (past run)
