Benchmark By Score Rank
Overall 1
AA Intelligence Index4.3.2 AA Intelligence Index 4.3.2: Artificial Analysis combines tests of knowledge, reasoning, coding and tool use into one score AA 6.7 #284 of 337
Knowledge 3
IFBench (instructions) IFBench (instructions): Checks whether the model follows precise formatting and content instructions AA 31% #213 of 248
SimpleQA Verifiedv1 SimpleQA Verified v1: Accuracy on short factual questions with verified answers, answered without web access 9.1% #79 of 83
Mystery Game Puzzles Mystery Game Puzzles: Models choose the best move in puzzle positions from an undisclosed game Epoch 12% #51 of 64
Reasoning 3
ARC-AGI-2public evaluation ARC-AGI-2 · public-eval: Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit ARC 0% #54 of 63+1 versions & slices semi-private ARC-AGI-2 · semi-private: Models infer transformations from examples and solve unseen grid puzzles; the evaluation split is explicit ARC 0% #59 of 66
Chess Puzzles Chess Puzzles: Models choose the best next move from a novel chess position Epoch 3% #66 of 68
Math 2
FrontierMath Tiers 1–3 (v2) FrontierMath Tiers 1–3 (v2): Models solve expert-written advanced mathematics problems on the named tier and edition Epoch 0.7% #68 of 69
MATH Level5 MATH Level 5: Models solve competition mathematics problems from the hardest MATH difficulty level Epoch 52.6% #20 of 35
Science 1
Humanity's Last Exam Humanity's Last Exam: Very hard expert questions across many fields, written to stump today’s models AA 4.2% #304 of 337
Agents 2
GDPval-AA (work tasks)2.1 GDPval-AA (work tasks) 2.1: Real work tasks from many professions (reports, spreadsheets, analyses), graded against expert work AA 0 #122 of 175
τ³-BankingAA τ³-Banking · AA: Agents retrieve banking knowledge and execute tools to resolve customer-support workflows AA 2.9% #132 of 134
Multimodal 5
MMMU-Pro (vision) MMMU-Pro (vision): College-level questions that require understanding images: charts, diagrams, photos AA 41.5% #121 of 127
MMMUvalidation MMMU · validation: Image-grounded university-level questions across 30 disciplines; validation and test sets remain separate MMMU 59.4% #25 of 41
OCRBenchv2 · CN OCRBench v2 · CN: Tests visual text recognition, localization and reasoning; English and Chinese subsets remain separate OCRBench 25% #4 of 4+1 versions & slices v2 · EN OCRBench v2 · EN: Tests visual text recognition, localization and reasoning; English and Chinese subsets remain separate OCRBench 43% #3 of 4
Arena Vision Arena Vision · overall: Human pairwise preferences in the stated vision vote pool Arena 1,066 #81 of 88
Writing 16
Arena Textcreative writing Arena Text · creative writing: Human pairwise preferences in the stated text vote pool Arena 1,294 #133 of 195+14 versions & slices overall Arena Text · overall: Human pairwise preferences in the stated text vote pool Arena 1,318 #145 of 196Chinese Arena Text · chinese: Human pairwise preferences in the stated text vote pool Arena 1,264 #145 of 181English Arena Text · english: Human pairwise preferences in the stated text vote pool Arena 1,301 #149 of 188French Arena Text · french: Human pairwise preferences in the stated text vote pool Arena 1,297 #119 of 149German Arena Text · german: Human pairwise preferences in the stated text vote pool Arena 1,272 #120 of 154instruction following Arena Text · instruction following: Human pairwise preferences in the stated text vote pool Arena 1,258 #146 of 188Japanese Arena Text · japanese: Human pairwise preferences in the stated text vote pool Arena 1,216 #105 of 138Korean Arena Text · korean: Human pairwise preferences in the stated text vote pool Arena 1,195 #121 of 144non-English Arena Text · non english: Human pairwise preferences in the stated text vote pool Arena 1,266 #146 of 188Polish Arena Text · polish: Human pairwise preferences in the stated text vote pool Arena 1,244 #124 of 133Russian Arena Text · russian: Human pairwise preferences in the stated text vote pool Arena 1,275 #140 of 186Spanish Arena Text · spanish: Human pairwise preferences in the stated text vote pool Arena 1,276 #131 of 155overall · full cohort Arena Text · overall · snapshot 2026-10-15 · native board settings: Human pairwise preferences in the stated text vote pool Arena 1,286 #148 of 188creative writing · full cohort Arena Text · creative writing · snapshot 2026-10-15 · native board settings: Human pairwise preferences in the stated text vote pool Arena 1,268 #138 of 187
EQ-Bench Creative Writingv3 Creative Writing v3 · Elo: Judge-rated creative writing under the v3 prompt set and pairwise ranking EQ-Bench 873 #79 of 91
Health & law 1
MLCR-AA MLCR-AA: Models synthesize long medical records; the headline credits concise answers judged both accurate and complete AA 0% #63 of 64
Legacy · saturated or no longer reported 9
Terminal-Bench2.1 Terminal-Bench 2.1 · source setting 2: Older, easier version of Terminal-Bench; Still widely reported AA 5.6% #135 of 156
AIME2025 · AA archived AIME 2025 · AA archived: AA evaluates the 30 integer-answer problems from the 2025 AIME mathematics competition AA 14.7% #119 of 140
LiveCodeBenchAA archived LiveCodeBench · AA archived: AA evaluates solutions to newly collected competitive-programming problems AA 23.4% #133 of 153+1 versions & slices official artifact (through April 2025) LiveCodeBench · official artifact (through April 2025): Mean pass@1 over each model’s available problems in the current official public generation artifact; its latest problem is dated April 7, 2025 LiveCodeBench 35.5% #10 of 10
GPQA Diamond GPQA Diamond: Graduate-level biology, chemistry and physics questions that can’t be solved by a quick web search 42.6% #275 of 315+1 versions & slices Epoch GPQA Diamond · source setting 2: Models answer graduate-level science multiple-choice questions Epoch 37.7% #117 of 133
Aider Polyglottwo attempts Aider Polyglot · two attempts: Models edit code for 225 Exercism exercises in six languages, with a second attempt after test feedback Aider 3.6% #15 of 15
MMLU-Proofficial board MMLU-Pro · official board: Graduate-level multiple-choice knowledge and reasoning across 14 subjects, including science, mathematics, law and health 63.1% #6 of 32
OTIS Mock AIME 20242025 OTIS Mock AIME 2024 2025: Models solve the stated OTIS mock AIME mathematics problems Epoch 6.9% #112 of 130
No benchmark matches
CheaperClaude Haiku 5.5max×6.5-24%$0.21Remove sampling parameters+5
OpenMiMo v2.6 Prothinking×7+107%$0.13Pass back reasoning_content+3
CheaperGLM 5.3 FlashmaxOpen×6.3-10%$0.28Defaults to max · Self-hosted+4
CheaperQwen3.8 FlashthinkingOpen×6-12%$0.37max_tokens range · QwenCloud+5
Granite 4.2 3BthinkingOpen+36%-80%$0.006No image input
Gemma 4 E4BthinkingOpen+34%-85%$0.008
DeepSeek V4.1 Flash 1017maxOpen×6.8+100%$0.26Pass back reasoning_content · Chat Completions+4
Step 5 PreviewthinkingOpen×6.6+443%$1.03No web search+3
Kimi K3maxOpen×6.5+2,186%$2.00Sampling parameters are fixed+3