Model Menu
Models
Compare
Leaderboard
Benchmarks
⌘K
Top
Chat
Coding
Agents
Writing
Vision
Image
Video
Speech
Embeddings
Decision
Music
Filters
Best for Decision models
All models
2292
Chat & Knowledge
558
Coding
381
Agents & Tool Use
541
Writing & Language
360
Vision & Documents
395
Image Generation & Editing
183
Video Generation
148
Speech & Voice
358
Embeddings & Retrieval
671
Decision models
118
Music & Sound
29
Community Decision Index 0.4.1
AA Decision · HLE (MCQ)
AA Decision cost per task
AA Decision Index v1.0
AA Decision time per task
JevBench
All benchmarks
12
Decision models benchmarks
12
×
Benchmark
By
Leader
Models
Community Decision Index
0.4.1
Community Decision Index 0.4.1: Decision models answer typed questions across knowledge, language, retrieval, tools and arts tasks
Community
b
mammoth-1 (27B)
68.9
99
AA Decision
Humanity's Last Exam text multiple-choice accuracy
AA Decision · HLE text MCQ accuracy: Decision models select answers to text-only Humanity’s Last Exam multiple-choice questions
AA
T
Jev 1.13
20.9%
15
+4 versions & slices
Omniscience accuracy
AA Decision · Omniscience accuracy: Decision models select correct answers to factual knowledge questions
AA
D1
41%
15
Omniscience non-hallucination rate
AA Decision · Omniscience non-hallucination rate: Decision models answer factual questions, scored on avoiding incorrect assertions
AA
D1 Ultra
84.5%
15
When2Call accuracy
AA Decision · When2Call accuracy: Decision models decide when a request requires a tool call
AA
D1 Ultra
92.6%
15
WildGuardTest average F1
AA Decision · WildGuardTest average F1: Decision models classify safety-related inputs, scored by average F1
AA
D1 Ultra
95.4%
15
AA Decision cost per task
v1.0
AA Decision cost per task v1.0: Decision models run the AA decision workload, measured by cost per task
AA
Decider Flash v1.2
0
15
AA Decision Index
v1.0
AA Decision Index v1.0: Decision models answer factual and multiple-choice questions and classify tool-use and safety cases in the AA composite
AA
D1 Ultra
65.2
15
AA Decision time per task
v1.0
AA Decision time per task v1.0: Decision models run the AA decision workload, measured by elapsed time per task
AA
C
Celeris-1 Decision
63
15
JevBench
v1.6.1
JevBench v1.6.1: Decision models produce typed choices, nulls and scores, evaluated by the stated intelligence, calibration, speed and cost composite
Benchmark
Mercury Decide
72.4
5
+2 versions & slices
v1.6.37 · open capability
JevBench v1.6.37 · open capability: Decision models produce typed choices, nulls and scores, evaluated on intelligence and calibration within the stated cost and latency caps
Benchmark
J
Kev 27B
78.9
5
v1.6.37 · api composite
JevBench v1.6.37 · api composite: Decision models produce typed choices, nulls and scores, evaluated by the stated intelligence, calibration, speed and cost composite
Benchmark
Mercury Decide
72.4
3
No benchmark matches
Model
AA Decision Index v1.0
Per task
Price
Speed
Supports
Context
D1 Ultra
Liquid AI
65.2
—
$0.042
/
—
—
33K
T
Jev 1.13
TypeSafe
57.5
—
$0.042
/
—
—
64K
T
Jev 1.14
TypeSafe
57.1
—
$0.042
/
—
—
64K
Decider v1.2
Perplexity
Open
56.2
—
$0.02
/
—
—
262K
F
GLiDE
Fastino
53.9
unstated
—
$0.15
/
—
—
40K
Microsoft Decision 1
Microsoft
53.8
—
$0.042
/
—
—
33K
Decider v1.1 27B
Perplexity
Open
53.1
—
—
8K
Mercury Decide
inception
52.7
—
$0.02
/
—
—
66K
C
Celeris-1 Decision
Celeris
52.3
—
$0.04
/
—
—
—
D1
Liquid AI
50.3
—
$0.02
/
—
—
66K
Decider Flash v1.2
Perplexity
Open
50.2
—
$0.01
/
—
—
262K
C
Clef
Cloudflare
Open
48.6
—
$0.24
/
—
—
66K
GPT-6 Luna Decisions
OpenAI
48.5
—
$0.10
/
—
—
1.05M
C
Clef Flash
Cloudflare
Open
45.8
—
$0.038
/
—
—
25K
C
Clef Omni
Cloudflare
Open
44.3
—
$0.15
/
—
—
64K
Show 103 not measured on AA Decision Index v1.0