Benchmark By Score Rank
Overall 1
AA Intelligence Index4.3.2 AA Intelligence Index 4.3.2: Artificial Analysis combines tests of knowledge, reasoning, coding and tool use into one score AA 18.6 #127 of 337
Knowledge 4
AA OmniscienceAccuracy AA Omniscience · Accuracy: Measures correct answers on the AA Omniscience factual knowledge test AA 23.2% #128 of 321+1 versions & slices Hallucination Rate AA Omniscience · Hallucination Rate: Measures how often attempted answers are incorrect on the AA Omniscience factual knowledge test AA 90.9% #259 of 321
AA Omniscience Index AA Omniscience Index: Scores factual knowledge while penalizing incorrect answers to encourage admitting uncertainty AA -46.6 #197 of 321
IFBench (instructions) IFBench (instructions): Checks whether the model follows precise formatting and content instructions AA 72.3% #38 of 248
Science 2
Humanity's Last Exam Humanity's Last Exam: Very hard expert questions across many fields, written to stump today’s models AA 13.7% #153 of 337
CritPt (physics) CritPt (physics): Research-level physics problems that need many careful reasoning steps AA 0.9% #130 of 324
Coding 3
WebDev Arena WebDev Arena: Human pairwise preferences in the stated webdev vote pool Arena 1,297 #86 of 97+1 versions & slices full cohort WebDev Arena · snapshot 2026-10-19 · native board settings: Human pairwise preferences in the stated webdev vote pool Arena 1,297 #86 of 97
Terminal-Bench Hard Terminal-Bench Hard (version unstated): Agents solve difficult software, system-administration and data-processing tasks in a terminal AA 25.8% #72 of 242
Writing 14
Arena Textcreative writing Arena Text · creative writing: Human pairwise preferences in the stated text vote pool Arena 1,283 #142 of 195+12 versions & slices overall Arena Text · overall: Human pairwise preferences in the stated text vote pool Arena 1,343 #128 of 196Chinese Arena Text · chinese: Human pairwise preferences in the stated text vote pool Arena 1,366 #120 of 181English Arena Text · english: Human pairwise preferences in the stated text vote pool Arena 1,364 #122 of 188French Arena Text · french: Human pairwise preferences in the stated text vote pool Arena 1,335 #113 of 149German Arena Text · german: Human pairwise preferences in the stated text vote pool Arena 1,357 #92 of 154instruction following Arena Text · instruction following: Human pairwise preferences in the stated text vote pool Arena 1,329 #115 of 188non-English Arena Text · non english: Human pairwise preferences in the stated text vote pool Arena 1,313 #128 of 188Polish Arena Text · polish: Human pairwise preferences in the stated text vote pool Arena 1,311 #106 of 133Russian Arena Text · russian: Human pairwise preferences in the stated text vote pool Arena 1,330 #120 of 186Spanish Arena Text · spanish: Human pairwise preferences in the stated text vote pool Arena 1,326 #121 of 155overall · full cohort Arena Text · overall · snapshot 2026-10-15 · native board settings: Human pairwise preferences in the stated text vote pool Arena 1,340 #125 of 188creative writing · full cohort Arena Text · creative writing · snapshot 2026-10-15 · native board settings: Human pairwise preferences in the stated text vote pool Arena 1,286 #131 of 187
EQ-Bench Longform Creative Writing1.11 Longform Creative Writing 1.11: Models plan, revise and write a story across eight turns, graded with a writing rubric EQ-Bench 46.4% #71 of 95
Documents 1
AA-LCR (long context)1.1 AA-LCR (long context) 1.1: Questions that need reading and connecting facts across very long documents (around 100K tokens) AA 64.3% #146 of 275
Legacy · saturated or no longer reported 10
τ²-benchAA τ²-Bench: Tests service agents that use tools while coordinating with a simulated user AA 86.8% #55 of 245
AIME2025 · AA archived AIME 2025 · AA archived: AA evaluates the 30 integer-answer problems from the 2025 AIME mathematics competition AA 78.3% #49 of 140
LiveCodeBenchAA archived LiveCodeBench · AA archived: AA evaluates solutions to newly collected competitive-programming problems AA 82.6% #11 of 153
GPQA Diamond GPQA Diamond: Graduate-level biology, chemistry and physics questions that can’t be solved by a quick web search 77.7% #130 of 315
SWE-rebenchall · 2025-10-01 to 2025-12-01 SWE-rebench · all · 2025-10-01 to 2025-12-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 35.9% #1 of 1+5 versions & slices Go · 2025-10-01 to 2025-12-01 SWE-rebench · go · 2025-10-01 to 2025-12-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 0% #1 of 1Java · 2025-10-01 to 2025-12-01 SWE-rebench · java · 2025-10-01 to 2025-12-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 0% #1 of 1Python · 2025-10-01 to 2025-12-01 SWE-rebench · python · 2025-10-01 to 2025-12-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 35.9% #1 of 1Rust · 2025-10-01 to 2025-12-01 SWE-rebench · rust · 2025-10-01 to 2025-12-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 0% #1 of 1TypeScript · 2025-10-01 to 2025-12-01 SWE-rebench · typescript · 2025-10-01 to 2025-12-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 0% #1 of 1
No benchmark matches