Model Menu
Models
Compare
Leaderboard
Benchmarks
⌘K
Top
Chat
Coding
Agents
Writing
Vision
Image
Video
Speech
Embeddings
Decision
Music
Filters
Best for Coding
All models
2292
Chat & Knowledge
558
Coding
381
Agents & Tool Use
541
Writing & Language
360
Vision & Documents
395
Image Generation & Editing
183
Video Generation
148
Speech & Voice
358
Embeddings & Retrieval
671
Decision models
118
Music & Sound
29
Terminal-Bench 4.0
DeepSWE 1.1
FrontierCode 1.1
SWE-bench Pro public
WebDev Arena
SWE-bench Pro v2 full
All benchmarks
54
Coding benchmarks
54
×
All
54
Coding
11
Agents
19
Code review
1
Benchmark
By
Leader
Models
Coding
11
WebDev Arena
WebDev Arena: Human pairwise preferences in the stated webdev vote pool
Arena
Claude Opus 5.5
1,807
97
+1 versions & slices
full cohort
WebDev Arena · snapshot 2026-10-19 · native board settings: Human pairwise preferences in the stated webdev vote pool
Arena
Claude Opus 5.5
1,807
97
SciCode
SciCode: Writing code for real scientific computing problems (physics, biology, math)
AA
Claude Opus 5.5
66.9%
140
LiveCodeBench
AA archived
LiveCodeBench · AA archived: AA evaluates solutions to newly collected competitive-programming problems
AA
Gemini 3 Flash Preview
90.8%
152
+2 versions & slices
official artifact (through April 2025)
LiveCodeBench · official artifact (through April 2025): Mean pass@1 over each model’s available problems in the current official public generation artifact; its latest problem is dated April 7, 2025
LiveCodeBench
o3
84.7%
10
LiveCodeBench
Reported by the lab with its own setup
Lab
DeepSeek V4 Pro 0813
93.5
8
Aider Polyglot
two attempts
Aider Polyglot · two attempts: Models edit code for 225 Exercism exercises in six languages, with a second attempt after test feedback
Aider
GPT-5
88%
15
+2 versions & slices
two attempts · diff edits · December 2024 run
Aider Polyglot · two attempts · two attempts / diff · historical run: Models edit code for 225 Exercism exercises in six languages, with a second attempt after test feedback
Aider
Qwen2.5 Coder 32B Instruct
8%
1
Aider Polyglot
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
76.1
1
MirrorCode
MirrorCode: Agents reimplement software projects by observing their behavior
Epoch
Claude Opus 5.5
77.4%
9
MultiLangBench
MultiLangBench: Models build a SQLite-compatible database engine in 20 programming languages
OpenAI
GPT-6 Astra
87.4%
8
Agents
11
Terminal-Bench
4.0
Terminal-Bench 4.0 · source setting 2: Agents use a terminal to complete executable coding, system administration and research tasks in the 4.0 suite
Claude Sonnet 5.5
63.6%
132
+2 versions & slices
2.1
Terminal-Bench 2.1 · source setting 2: Older, easier version of Terminal-Bench; Still widely reported
AA
Claude Fable 5.1
91.4%
156
3.0
Reported by the lab with its own setup
Lab
Claude Opus 5
43.3
6
DeepSWE
1.1
DeepSWE 1.1: Agents change repository code to resolve software engineering tasks under the stated DeepSWE edition
GPT-6 Astra
74.1%
44
+1 versions & slices
1
DeepSWE 1: Agents change repository code to resolve software engineering tasks under the stated DeepSWE edition
Datacurve
GPT-5.5
70%
20
FrontierCode
1.1
FrontierCode 1.1: Agents implement changes in real repositories, graded against maintainer-defined requirements
AA
Claude Opus 5.5
57.1%
28
SWE-bench Pro (v2 full)
SWE-bench Pro (v2 full): Agents resolve repository issues under the network-locked v2 protocol; full and 51-task Hard results are separate
Scale
Claude Opus 5
99.4%
16
SWE-bench Pro (v2 hard)
SWE-bench Pro (v2 hard): Agents resolve repository issues under the network-locked v2 protocol; full and 51-task Hard results are separate
Scale
Claude Opus 5
98%
16
SWE-bench Pro (private)
SWE-bench Pro (private): Agents resolve long-horizon professional repository tasks; public and private splits are separate
Scale
Muse Spark 1.1
51.5%
9
Terminal-Bench Science
0.1
Terminal-Bench Science 0.1: Agents complete expert-authored research workflows across five scientific domains in a terminal
AA
GPT-6 Astra
63.3%
33
Terminal-Bench Hard
Terminal-Bench Hard (version unstated): Agents solve difficult software, system-administration and data-processing tasks in a terminal
AA
GPT-5.6 Sol
65.9%
239
Code review
1
Code Review Bench
Core F2
Review systems identify pull-request defects; core F2 weights recall more heavily than precision over the published gold set
Martian
Reported by labs
23
SWE-bench Pro (edition unstated)
Reported by the lab with its own setup
Lab
Claude Opus 5.5
89.9
44
DeepSWE (edition unstated)
Reported by the lab with its own setup
Lab
Claude Fable 5
70
11
SciCode Verified pass@1 n=6
Reported by the lab with its own setup
Lab
GPT-6 Astra
94.2
11
Terminal Bench
2.0
Reported by the lab with its own setup
Lab
GPT-5.4
75.1
8
SWE-bench Verified resolved
Reported by the lab with its own setup
Lab
DeepSeek R1
49.2
4
LiveCodeBench pass@1
Reported by the lab with its own setup
Lab
DeepSeek R1 Distill Llama 70B
57.5
8
Codeforces Rating
Reported by the lab with its own setup
Lab
DeepSeek V4.1 Flash 1017
3,471
15
SWE Verified
Reported by the lab with its own setup
Lab
Claude Opus 4.6
80.8
7
ProgramBench
Reported by the lab with its own setup
Lab
Claude Opus 5
37
6
NL2Repo-Bench
Reported by the lab with its own setup
Lab
Claude Opus 5
75.3
6
Meta Internal Coding Bench
Reported by the lab with its own setup
Lab
Claude Opus 4.8
69
5
Surge Human Eval on Code
Reported by the lab with its own setup
Lab
Claude Opus 5
4.2
5
SWE Atlas QnA
Reported by the lab with its own setup
Lab
DeepSeek V4 Pro 0813
66
5
SWE Multilingual
Reported by the lab with its own setup
Lab
Claude Opus 4.6
77.5
4
Codeforces percentile
Reported by the lab with its own setup
Lab
o1 1217
96.6
4
COBOL migration eval
Reported by the lab with its own setup
Lab
GPT-6.1 Sol
86.6
4
Vibe Code Bench
v1.1
Reported by the lab with its own setup
Lab
Muse Spark 1.1
72.2
2
SWE Atlas Codebase QnA
Reported by the lab with its own setup
Lab
Muse Spark 1.1
42
2
SWE-bench Multilingual
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
57.8
1
Terminal-bench version unstated
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
36.7
1
Codeforces-Div1 rating
Reported by the lab with its own setup
Lab
DeepSeek V3.1 Terminus
2,046
1
SWE Marathon
Reported by the lab with its own setup
Lab
Kimi K3.1 Pro
51.7
1
Kimi Code Bench 3.0 Long-horizon
Reported by the lab with its own setup
Lab
Kimi K3.1 Pro
61.2
1
Legacy · saturated or no longer reported
8
SWE-bench Pro (public)
SWE-bench Pro (public): Agents resolve long-horizon professional repository tasks; public and private splits are separate
Muse Spark 1.1
61.5%
19
SWE-rebench
all · 2026-02-01 to 2026-07-01
SWE-rebench · all · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
29.5%
1
+5 versions & slices
Go · 2026-02-01 to 2026-07-01
SWE-rebench · go · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
18.1%
1
Java · 2026-02-01 to 2026-07-01
SWE-rebench · java · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
16.2%
1
Python · 2026-02-01 to 2026-07-01
SWE-rebench · python · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
42.6%
1
Rust · 2026-02-01 to 2026-07-01
SWE-rebench · rust · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
22.4%
1
TypeScript · 2026-02-01 to 2026-07-01
SWE-rebench · typescript · 2026-02-01 to 2026-07-01: Repository issue resolution over the exact fresh pull-request window, under the source agent version
Nebius
Qwen 3.5 35B A3B
16.7%
1
SWE-bench Verified
Epoch
Swe Bench Verified: Agents modify real repositories to resolve the stated Verified issues
Epoch
Claude Opus 4.7
83.5%
24
No benchmark matches
Model
DeepSWE 1.1
Per task
Price
Speed
Supports
Context
GPT-6 Astra
OpenAI
74.1
xhigh
$2.31
$10
/
$50
61
1.05M
Gemini 3.8 Flash
Google
73.8
high
$1.24
$0.75
/
$3.75
149
1M
Claude Opus 5
Anthropic
73.6
max
$5.86
$5
/
$25
55
1M
GPT-5.6 Sol
OpenAI
72.7
max
$1.99
$4
/
$20
114
1.05M
Claude Opus 5.5
Anthropic
72.3
max
—
$4
/
$20
—
1M
GPT-6.1 Sol
OpenAI
72.3
max
—
$2
/
$10
—
1.05M
Claude Sonnet 5.5
Anthropic
70.5
max
—
$2
/
$10
—
1M
GPT-6 Sol
OpenAI
70.5
max
—
$2
/
$10
—
1.05M
Claude Fable 5
Anthropic
69.9
xhigh
—
$10
/
$50
—
1M
GPT-5.6 Terra
OpenAI
69.6
max
$1.40
$2
/
$12
142
1.05M
GLM 5.3
Z.ai
Open
69
max
$2.01
$1.40
/
$4.40
186
1M
Kimi K3
Moonshot AI
Open
68.5
max
$2.00
$3
/
$15
112
1M
Muse Spark 1.3
Meta
67.8
xhigh
—
$1.25
/
$4.25
—
1M
Grok 4.6
xAI
67.5
medium
$1.14
$2
/
$6
68
500K
GPT-5.6 Luna
OpenAI
67.2
max
$0.18
$0.20
/
$1.20
178
1.05M
GPT-5.5
OpenAI
67
xhigh
$2.63
$5
/
$30
113
1.05M
GPT-6 Luna
OpenAI
67
max
—
$0.10
/
$0.50
—
1.05M
GLM 5.3 Flash
Z.ai
Open
63.4
max
$0.28
$0.15
/
$0.50
179
1M
DeepSeek V4 Pro 0813
DeepSeek
Open
62.8
max
—
$1.32
/
$3.96
—
1M
Claude Opus 4.8
Anthropic
59
max
$4.08
$5
/
$25
66
1M
Muse Spark 1.2
Meta
54.9
xhigh
$0.97
$1.25
/
$4.25
355
1M
Claude Sonnet 5
Anthropic
53.8
max
$5.09
$2
/
$10
80
1M
Grok 4.5
xAI
53.8
high
$0.88
$2
/
$6
63
500K
DeepSeek V4.1 Flash 1017
DeepSeek
Open
53.3
max
—
$0.30
/
$1.20
—
1M
Muse Spark 1.1
Meta
53.3
xhigh
$1.38
$1.25
/
$4.25
280
1M
GPT-5.4
OpenAI
51.8
xhigh
—
$2.50
/
$15
127
1.05M
Claude Opus 4.7
Anthropic
49.3
max
—
$5
/
$25
—
1M
Gemini 3.6 Flash
Google
46.7
high
$1.60
$0.75
/
$3.75
209
1M
GLM 5.2
Z.ai
Open
43.8
max
$1.47
$1.40
/
$4.40
189
1M
Grok 4.7
xAI
33.3
xhigh
—
$2
/
$6
—
500K
Claude Opus 4.6
Anthropic
31.9
max
—
$5
/
$25
—
1M
Kimi K2.7 Code
Moonshot AI
Open
30.5
unstated
—
$0.95
/
$4
—
256K
Claude Sonnet 4.6
Anthropic
29.9
high
—
$3
/
$15
—
1M
GLM 5.1
Z.ai
Open
18.9
unstated
—
$1.40
/
$4.40
—
203K
Gemini 3.1 Pro Preview
Google
11.7
high
—
$2
/
$12
—
1M
MiniMax M3
MiniMax
Open
9.1
high
—
$0.30
/
$1.20
—
524K
Gemini 3.1 Pro
Google
7.7
high
—
$2
/
$12
—
1M
T
Inkling
Thinking Machines
Open
5
high
—
$0.95
/
$4.05
—
256K
GLM 5
Z.ai
Open
2.1
unstated
—
$1
/
$3.20
—
203K
Nemotron 3 Ultra
NVIDIA
Open
0.6
high
—
$0.50
/
$2.50
—
1M
Gemma 4 31B
Google
Open
0
unstated
—
$0.10
/
$0.34
—
256K
MiniMax M2.7
MiniMax
Open
0
high
—
$0.30
/
$1.20
—
205K
Kimi K2 0711
Moonshot AI
Open
0
high
—
$0.50
/
$2
—
128K
GPT OSS 120B
OpenAI
Open
0
high
—
$0.03
/
$0.15
—
131K
Show 337 not measured on DeepSWE 1.1