D1 Ultra vs Decider v1.2
AA Decision Index v1.0 AA Decision Index v1.0: Decision models answer factual and multiple-choice questions and classify tool-use and safety cases in the AA composite
D1 Ultra65.2
Decider v1.256.2
AA Decision · Humanity's Last Exam text multiple-choice accuracy AA Decision · HLE text MCQ accuracy: Decision models select answers to text-only Humanity’s Last Exam multiple-choice questions
D1 Ultra15
Decider v1.214.6
AA Decision · Omniscience accuracy AA Decision · Omniscience accuracy: Decision models select correct answers to factual knowledge questions
D1 Ultra31.6
Decider v1.239.4
AA Decision · Omniscience non-hallucination rate AA Decision · Omniscience non-hallucination rate: Decision models answer factual questions, scored on avoiding incorrect assertions
D1 Ultra84.5
Decider v1.216.5
AA Decision · When2Call accuracy AA Decision · When2Call accuracy: Decision models decide when a request requires a tool call
D1 Ultra92.6
Decider v1.287.7
AA Decision · WildGuardTest average F1 AA Decision · WildGuardTest average F1: Decision models classify safety-related inputs, scored by average F1
D1 Ultra95.4
Decider v1.294.4
AA Decision cost per task v1.0 AA Decision cost per task v1.0: Decision models run the AA decision workload, measured by cost per task · lower is better
D1 Ultra0
Decider v1.20
AA Decision time per task v1.0 AA Decision time per task v1.0: Decision models run the AA decision workload, measured by elapsed time per task · lower is better
D1 Ultra93
Decider v1.2206
Community Decision Index 0.4.1 Community Decision Index 0.4.1: Decision models answer typed questions across knowledge, language, retrieval, tools and arts tasks
D1 Ultra—
Decider v1.268
| Benchmark | D1 Ultra | Decider v1.2 |
|---|---|---|
| AA Decision Index v1.0 | 65.2 | 56.2 |
| AA Decision · Humanity's Last Exam text multiple-choice accuracy | 15 | 14.6 |
| AA Decision · Omniscience accuracy | 31.6 | 39.4 |
| AA Decision · Omniscience non-hallucination rate | 84.5 | 16.5 |
| AA Decision · When2Call accuracy | 92.6 | 87.7 |
| AA Decision · WildGuardTest average F1 | 95.4 | 94.4 |
| AA Decision cost per task v1.0 | 0 | 0 |
| AA Decision time per task v1.0 | 93 | 206 |
| Community Decision Index 0.4.1 | — | 68 |
Specs
| Spec | D1 Ultra | Decider v1.2 |
|---|---|---|
| Input, per 1M | !$0.042 | !$0.02 |
| Context | 33K | 262K |
| Weights | Closed | Open |
| Released | Oct 2026 | Oct 2026 |
| Memory (4-bit) | — | 15 GB |
| Licence | — | Apache-2.0 |
| Commercial use | — | Allowed |
| See images | ✓ | ✓ |
| Read PDFs | — | — |
| Hear audio | — | — |
| Watch video | — | — |
| Call tools | — | — |
| Force a tool call | ? | ? |
| Return strict JSON | Partial | Partial |
| Search the web | ? | ? |
| Run code | ? | ? |
| Use a computer | ? | ? |
What breaks when you switch
D1 Ultra → Decider v1.2
Nothing known.
Decider v1.2 → D1 Ultra