Benchmark By Score Rank
Overall 1
AA Intelligence Index4.3.2 Artificial Analysis combines tests of knowledge, reasoning, coding and tool use into one score AA 19.3 #126 of 339
Knowledge 4
AA OmniscienceAccuracy Measures correct answers on the AA Omniscience factual knowledge test AA 20.1% #156 of 323+1 versions & slices Hallucination Rate Measures how often attempted answers are incorrect on the AA Omniscience factual knowledge test AA 85.4% #208 of 323
AA Omniscience Index Scores factual knowledge while penalizing incorrect answers to encourage admitting uncertainty AA -48.1 #202 of 323
IFBench (instructions) Checks whether the model follows precise formatting and content instructions AA 72.5% #36 of 248
Math 7
MathArenaAIME 2026 Answer accuracy on the named mathematics competition under the recorded effort MathArena 93.3% #19 of 24+6 versions & slices HMMT February 2026 Answer accuracy on the named mathematics competition under the recorded effort MathArena 81.8% #20 of 24Apex Answer accuracy on the named mathematics competition under the recorded effort MathArena 4.2% #21 of 34Apex Shortlist Answer accuracy on the named mathematics competition under the recorded effort MathArena 44.7% #25 of 30ArXivMath · December 2025 Answer accuracy on the named mathematics competition under the recorded effort MathArena 39.7% #8 of 13ArXivMath · February 2026 Answer accuracy on the named mathematics competition under the recorded effort MathArena 30.5% #17 of 20ArXivMath · January 2026 Answer accuracy on the named mathematics competition under the recorded effort MathArena 50% #15 of 18
Science 2
Humanity's Last Exam Very hard expert questions across many fields, written to stump today’s models AA 21% #122 of 339
CritPt (physics) Research-level physics problems that need many careful reasoning steps AA 0.9% #132 of 326
Coding 5
WebDev Arena Human pairwise preferences in the stated webdev vote pool Arena 1,254 #90 of 97+2 versions & slices October 23, 2026 Human pairwise preferences in the stated webdev vote pool Arena 1,254 #91 of 98October 19, 2026 Human pairwise preferences in the stated webdev vote pool Arena 1,254 #90 of 97
ITBench SRE IT incident tasks: diagnose and fix broken systems like a site-reliability engineer AA 21.5% #35 of 37
Terminal-Bench Hard Agents solve difficult software, system-administration and data-processing tasks in a terminal AA 26.5% #68 of 242
Agents 2
GDPval-AA (work tasks)2.1 Real work tasks from many professions (reports, spreadsheets, analyses), graded against expert work AA 5.4 #144 of 177
τ³-BankingAA Agents retrieve banking knowledge and execute tools to resolve customer-support workflows AA 4.9% #120 of 134
Multimodal 1
MMMU-Pro (vision) College-level questions that require understanding images: charts, diagrams, photos AA 72.7% #68 of 128
Writing 18
Arena Textcreative writing · October 22, 2026 Human pairwise preferences in the stated text vote pool Arena 1,347 #97 of 197+16 versions & slices creative writing Human pairwise preferences in the stated text vote pool Arena 1,343 #105 of 195overall Human pairwise preferences in the stated text vote pool Arena 1,394 #104 of 196Chinese Human pairwise preferences in the stated text vote pool Arena 1,456 #79 of 198English Human pairwise preferences in the stated text vote pool Arena 1,407 #100 of 205French Human pairwise preferences in the stated text vote pool Arena 1,413 #92 of 164German Human pairwise preferences in the stated text vote pool Arena 1,367 #95 of 167instruction following Human pairwise preferences in the stated text vote pool Arena 1,379 #98 of 205Japanese Human pairwise preferences in the stated text vote pool Arena 1,326 #88 of 152Korean Human pairwise preferences in the stated text vote pool Arena 1,354 #85 of 156non-English Human pairwise preferences in the stated text vote pool Arena 1,378 #103 of 205Polish Human pairwise preferences in the stated text vote pool Arena 1,385 #85 of 142Russian Human pairwise preferences in the stated text vote pool Arena 1,377 #103 of 203Spanish Human pairwise preferences in the stated text vote pool Arena 1,390 #98 of 168overall · October 15, 2026 Human pairwise preferences in the stated text vote pool Arena 1,395 #95 of 188creative writing · October 15, 2026 Human pairwise preferences in the stated text vote pool Arena 1,348 #93 of 187overall · October 22, 2026 Human pairwise preferences in the stated text vote pool Arena 1,395 #100 of 198
EQ-Bench Longform Creative Writing1.11 Longform Creative Writing 1.11: Models plan, revise and write a story across eight turns, graded with a writing rubric EQ-Bench 44.5% #73 of 96
Documents 1
AA-LCR (long context)1.1 Questions that need reading and connecting facts across very long documents (around 100K tokens) AA 72% #110 of 317
Legacy · saturated or no longer reported 11
GPQA Diamond Graduate-level biology, chemistry and physics questions that can’t be solved by a quick web search 84.5% #85 of 315+1 versions & slices Epoch Models answer graduate-level science multiple-choice questions Epoch 83.5% #60 of 134
OTIS Mock AIME 20242025 Models solve the stated OTIS mock AIME mathematics problems Epoch 70% #78 of 131
SWE-rebenchall · February 1, 2026 to July 1, 2026 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 29.5% #1 of 1+5 versions & slices Go · February 1, 2026 to July 1, 2026 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 18.1% #1 of 1Java · February 1, 2026 to July 1, 2026 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 16.2% #1 of 1Python · February 1, 2026 to July 1, 2026 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 42.6% #1 of 1Rust · February 1, 2026 to July 1, 2026 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 22.4% #1 of 1TypeScript · February 1, 2026 to July 1, 2026 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 16.7% #1 of 1
τ²-benchAA Tests service agents that use tools while coordinating with a simulated user AA 89.2% #46 of 245
Terminal-Bench2.1 Older, easier version of Terminal-Bench; Still widely reported AA 40.8% #83 of 156
No benchmark matches