Benchmark By Score Rank
Overall 1
AA Intelligence Index4.3.2 Artificial Analysis combines tests of knowledge, reasoning, coding and tool use into one score AA 9.9 #212 of 339
Knowledge 5
AA OmniscienceAccuracy Measures correct answers on the AA Omniscience factual knowledge test AA 26.1% #105 of 323+1 versions & slices Hallucination Rate Measures how often attempted answers are incorrect on the AA Omniscience factual knowledge test AA 93% #287 of 323
AA Omniscience Index Scores factual knowledge while penalizing incorrect answers to encourage admitting uncertainty AA -42.6 #184 of 323
IFBench (instructions) Checks whether the model follows precise formatting and content instructions AA 39% #164 of 248
SimpleQA Verifiedv1 Accuracy on short factual questions with verified answers, answered without web access 28.1% #62 of 84
Math 7
FrontierMath Models solve expert-written advanced mathematics problems on the named tier and edition Epoch 4.8% #31 of 40
FrontierMath Tier4 Models solve expert-written advanced mathematics problems on the named tier and edition Epoch 4.2% #16 of 33
MathArenaAIME 2025 Answer accuracy on the named mathematics competition under the recorded effort MathArena 70.8% #24 of 30+4 versions & slices BRUMO 2025 Answer accuracy on the named mathematics competition under the recorded effort MathArena 83.3% #22 of 24CMIMC 2025 Answer accuracy on the named mathematics competition under the recorded effort MathArena 54.4% #22 of 22HMMT February 2025 Answer accuracy on the named mathematics competition under the recorded effort MathArena 64.2% #22 of 30SMT 2025 Answer accuracy on the named mathematics competition under the recorded effort MathArena 75.5% #23 of 24
Science 2
Humanity's Last Exam Very hard expert questions across many fields, written to stump today’s models AA 4.7% #291 of 339
CritPt (physics) Research-level physics problems that need many careful reasoning steps AA 1.4% #115 of 326
Coding 1
Terminal-Bench Hard Agents solve difficult software, system-administration and data-processing tasks in a terminal AA 12.1% #118 of 242
Multimodal 2
MMMU-Pro (vision) College-level questions that require understanding images: charts, diagrams, photos AA 65.5% #80 of 128
Arena Vision Human pairwise preferences in the stated vision vote pool Arena 1,235 #53 of 88
Writing 17
Arena Textcreative writing · October 22, 2026 Human pairwise preferences in the stated text vote pool Arena 1,400 #66 of 197+16 versions & slices creative writing Human pairwise preferences in the stated text vote pool Arena 1,394 #73 of 195overall Human pairwise preferences in the stated text vote pool Arena 1,409 #91 of 196Chinese Human pairwise preferences in the stated text vote pool Arena 1,450 #80 of 198English Human pairwise preferences in the stated text vote pool Arena 1,418 #89 of 205French Human pairwise preferences in the stated text vote pool Arena 1,432 #79 of 164German Human pairwise preferences in the stated text vote pool Arena 1,418 #65 of 167instruction following Human pairwise preferences in the stated text vote pool Arena 1,405 #80 of 205Japanese Human pairwise preferences in the stated text vote pool Arena 1,396 #53 of 152Korean Human pairwise preferences in the stated text vote pool Arena 1,385 #56 of 156non-English Human pairwise preferences in the stated text vote pool Arena 1,409 #73 of 205Polish Human pairwise preferences in the stated text vote pool Arena 1,413 #65 of 142Russian Human pairwise preferences in the stated text vote pool Arena 1,415 #71 of 203Spanish Human pairwise preferences in the stated text vote pool Arena 1,422 #73 of 168overall · October 15, 2026 Human pairwise preferences in the stated text vote pool Arena 1,417 #78 of 188creative writing · October 15, 2026 Human pairwise preferences in the stated text vote pool Arena 1,400 #63 of 187overall · October 22, 2026 Human pairwise preferences in the stated text vote pool Arena 1,417 #80 of 198
Health & law 3
MLCR-AA Models synthesize long medical records; the headline credits concise answers judged both accurate and complete AA 8.3% #65 of 103
Vals MedCode Medical coding accuracy on patient encounters Vals 40.4% #51 of 78
Vals MedScribe Accuracy of clinical notes produced from consultation transcripts Vals 83% #41 of 80
Documents 1
AA-LCR (long context)1.1 Questions that need reading and connecting facts across very long documents (around 100K tokens) AA 49.9% #181 of 317
Other 1
AA Speech to textRecorded audio word error rate Measures transcription errors as a share of reference words in the non-streaming test AA 5.1% #43 of 55
Legacy · saturated or no longer reported 12
τ²-benchAA Tests service agents that use tools while coordinating with a simulated user AA 14.9% #212 of 245
AIME2025 · AA archived AA evaluates the 30 integer-answer problems from the 2025 AIME mathematics competition AA 60.3% #79 of 140
LiveCodeBenchAA archived AA evaluates solutions to newly collected competitive-programming problems AA 49.5% #90 of 153
GPQA Diamond Graduate-level biology, chemistry and physics questions that can’t be solved by a quick web search 68.3% #194 of 315
BFCLv4 Tests function calling, multi-turn interactions, search and memory in the v4 suite Berkeley 56.2% #6 of 39+1 versions & slices v4 · prompt mode Tests function calling, multi-turn interactions, search and memory in the v4 suite Berkeley 50.9% #1 of 16
SWE-rebenchall · July 1, 2025 to November 1, 2025 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 19.9% #2 of 2+5 versions & slices Go · July 1, 2025 to November 1, 2025 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 0% #1 of 2Java · July 1, 2025 to November 1, 2025 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 0% #1 of 2Python · July 1, 2025 to November 1, 2025 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 19.9% #2 of 2Rust · July 1, 2025 to November 1, 2025 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 0% #1 of 2TypeScript · July 1, 2025 to November 1, 2025 Repository issue resolution over the exact fresh pull-request window, under the source agent version Nebius 0% #1 of 2
No benchmark matches