Model Menu
Models
Compare
Leaderboard
Benchmarks
⌘K
Top
Chat
Coding
Agents
Writing
Vision
Image
Video
Speech
Embeddings
Decision
Music
Filters
Best for Coding
All models
2292
Chat & Knowledge
558
Coding
381
Agents & Tool Use
541
Writing & Language
360
Vision & Documents
395
Image Generation & Editing
183
Video Generation
148
Speech & Voice
358
Embeddings & Retrieval
671
Decision models
118
Music & Sound
29
Terminal-Bench 4.0
DeepSWE 1.1
FrontierCode 1.1
SWE-bench Pro public
WebDev Arena
SWE-bench Pro v2 full
SWE-bench Pro private
All benchmarks
54
Coding benchmarks
54
×
All
54
Coding
11
Agents
19
Code review
1
Benchmark
By
Leader
Models
Coding
11
WebDev Arena
WebDev Arena: Human pairwise preferences in the stated webdev vote pool
Arena
Claude Opus 5.5
1,807
97
+1 versions & slices
full cohort
WebDev Arena · snapshot 2026-10-19 · native board settings: Human pairwise preferences in the stated webdev vote pool
Arena
Claude Opus 5.5
1,807
97
SciCode
SciCode: Writing code for real scientific computing problems (physics, biology, math)
AA
Claude Opus 5.5
66.9%
140
LiveCodeBench
AA archived
LiveCodeBench · AA archived: AA evaluates solutions to newly collected competitive-programming problems
AA
Gemini 3 Flash Preview
90.8%
152
+2 versions & slices
official artifact (through April 2025)
LiveCodeBench · official artifact (through April 2025): Mean pass@1 over each model’s available problems in the current official public generation artifact; its latest problem is dated April 7, 2025
LiveCodeBench
o3
84.7%
10
LiveCodeBench
Reported by the lab with its own setup
Lab
DeepSeek V4 Pro 0813
93.5
8
Aider Polyglot
two attempts
Aider Polyglot · two attempts: Models edit code for 225 Exercism exercises in six languages, with a second attempt after test feedback
Aider
GPT-5
88%
15
+2 versions & slices
two attempts · diff edits · December 2024 run
Aider Polyglot · two attempts · two attempts / diff · historical run: Models edit code for 225 Exercism exercises in six languages, with a second attempt after test feedback
Aider
Qwen2.5 Coder 32B Instruct
8%
1
Aider Polyglot
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
76.1
1
MirrorCode
MirrorCode: Agents reimplement software projects by observing their behavior
Epoch
Claude Opus 5.5
77.4%
9
MultiLangBench
MultiLangBench: Models build a SQLite-compatible database engine in 20 programming languages
OpenAI
GPT-6 Astra
87.4%
8
Agents
11
Terminal-Bench
4.0
Terminal-Bench 4.0 · source setting 2: Agents use a terminal to complete executable coding, system administration and research tasks in the 4.0 suite
Claude Sonnet 5.5
63.6%
132
+2 versions & slices
2.1
Terminal-Bench 2.1 · source setting 2: Older, easier version of Terminal-Bench; Still widely reported
AA
Claude Fable 5.1
91.4%
156
3.0
Reported by the lab with its own setup
Lab
Claude Opus 5
43.3
6
DeepSWE
1.1
DeepSWE 1.1: Agents change repository code to resolve software engineering tasks under the stated DeepSWE edition
GPT-6 Astra
74.1%
44
+1 versions & slices
1
DeepSWE 1: Agents change repository code to resolve software engineering tasks under the stated DeepSWE edition
Datacurve
GPT-5.5
70%
20
FrontierCode
1.1
FrontierCode 1.1: Agents implement changes in real repositories, graded against maintainer-defined requirements
AA
Claude Opus 5.5
57.1%
28
SWE-bench Pro (v2 full)
SWE-bench Pro (v2 full): Agents resolve repository issues under the network-locked v2 protocol; full and 51-task Hard results are separate
Scale
Claude Opus 5
99.4%
16
SWE-bench Pro (v2 hard)
SWE-bench Pro (v2 hard): Agents resolve repository issues under the network-locked v2 protocol; full and 51-task Hard results are separate
Scale
Claude Opus 5
98%
16
SWE-bench Pro (private)
SWE-bench Pro (private): Agents resolve long-horizon professional repository tasks; public and private splits are separate
Scale
Muse Spark 1.1
51.5%
9
Terminal-Bench Science
0.1
Terminal-Bench Science 0.1: Agents complete expert-authored research workflows across five scientific domains in a terminal
AA
GPT-6 Astra
63.3%
33
Terminal-Bench Hard
Terminal-Bench Hard (version unstated): Agents solve difficult software, system-administration and data-processing tasks in a terminal
AA
GPT-5.6 Sol
65.9%
239
Code review
1
Code Review Bench
Core F2
Review systems identify pull-request defects; core F2 weights recall more heavily than precision over the published gold set
Martian
Reported by labs
23
SWE-bench Pro (edition unstated)
Reported by the lab with its own setup
Lab
Claude Opus 5.5
89.9
44
DeepSWE (edition unstated)
Reported by the lab with its own setup
Lab
Claude Fable 5
70
11
SciCode Verified pass@1 n=6
Reported by the lab with its own setup
Lab
GPT-6 Astra
94.2
11
Terminal Bench
2.0
Reported by the lab with its own setup
Lab
GPT-5.4
75.1
8
SWE-bench Verified resolved
Reported by the lab with its own setup
Lab
DeepSeek R1
49.2
4
LiveCodeBench pass@1
Reported by the lab with its own setup
Lab
DeepSeek R1 Distill Llama 70B
57.5
8
Codeforces Rating
Reported by the lab with its own setup
Lab
DeepSeek V4.1 Flash 1017
3,471
15
SWE Verified
Reported by the lab with its own setup
Lab
Claude Opus 4.6
80.8
7
ProgramBench
Reported by the lab with its own setup
Lab
Claude Opus 5
37
6
NL2Repo-Bench
Reported by the lab with its own setup
Lab
Claude Opus 5
75.3
6
Meta Internal Coding Bench
Reported by the lab with its own setup
Lab
Claude Opus 4.8
69
5
Surge Human Eval on Code
Reported by the lab with its own setup
Lab
Claude Opus 5
4.2
5
SWE Atlas QnA
Reported by the lab with its own setup
Lab
DeepSeek V4 Pro 0813
66
5
SWE Multilingual
Reported by the lab with its own setup
Lab
Claude Opus 4.6
77.5
4
Codeforces percentile
Reported by the lab with its own setup
Lab
o1 1217
96.6
4
COBOL migration eval
Reported by the lab with its own setup
Lab
GPT-6.1 Sol
86.6
4
Vibe Code Bench
v1.1
Reported by the lab with its own setup
Lab
Muse Spark 1.1
72.2
2
SWE Atlas Codebase QnA
Reported by the lab with its own setup
Lab
Muse Spark 1.1
42
2
SWE-bench Multilingual
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
57.8
1
Terminal-bench version unstated
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
36.7
1
Codeforces-Div1 rating
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
2,046
1
SWE Marathon
Reported by the lab with its own setup
Lab
Kimi K3.1 Pro
51.7
1
Kimi Code Bench 3.0 Long-horizon
Reported by the lab with its own setup
Lab
Kimi K3.1 Pro
61.2
1
Legacy · saturated or no longer reported
8
SWE-bench Pro (public)
SWE-bench Pro (public): Agents resolve long-horizon professional repository tasks; public and private splits are separate
Muse Spark 1.1
61.5%
19
SWE-rebench
all · 2026-02-01 to 2026-07-01
SWE-rebench · all · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
29.5%
1
+5 versions & slices
Go · 2026-02-01 to 2026-07-01
SWE-rebench · go · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
18.1%
1
Java · 2026-02-01 to 2026-07-01
SWE-rebench · java · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
16.2%
1
Python · 2026-02-01 to 2026-07-01
SWE-rebench · python · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
42.6%
1
Rust · 2026-02-01 to 2026-07-01
SWE-rebench · rust · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
22.4%
1
TypeScript · 2026-02-01 to 2026-07-01
SWE-rebench · typescript · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
16.7%
1
SWE-bench Verified
Epoch
Swe Bench Verified: Agents modify real repositories to resolve the stated Verified issues
Epoch
Claude Opus 4.7
83.5%
24
No benchmark matches
Model
SWE-bench Pro private
Per task
Price
Speed
Supports
Context
Muse Spark 1.1
Meta
51.5
unstated
—
$1.25
/
$4.25
—
1M
Claude Opus 4.6
Anthropic
47.1
unstated
—
$5
/
$25
—
1M
Muse Spark
Meta
44.7
unstated
—
$1.25
/
$4.25
—
1M
GPT-5.4
OpenAI
43.4
xhigh
—
$2.50
/
$15
127
1.05M
Gemini 3.1 Pro
Google
32.2
unstated
—
$2
/
$12
—
1M
GPT-5.2
OpenAI
23.8
unstated
—
$1.75
/
$14
—
400K
Claude Opus 4.5
Anthropic
23.4
unstated
—
$5
/
$25
—
200K
GPT-5
OpenAI
14.9
unstated
—
$1.25
/
$10
—
400K
GPT-4o
OpenAI
3.6
unstated
—
$2.50
/
$10
—
128K
Show 372 not measured on SWE-bench Pro private
