D1 Ultra vs Jev 1.14
| Benchmark | D1 Ultra | Jev 1.14 |
|---|---|---|
| AA Decision Index v1.0 | 65.2 | 57.1 |
| AA Decision · Humanity's Last Exam text multiple-choice accuracy | 15 | 18.9 |
| AA Decision · Omniscience accuracy | 31.6 | 33.8 |
| AA Decision · Omniscience non-hallucination rate | 84.5 | 37.2 |
| AA Decision · When2Call accuracy | 92.6 | 80.8 |
| AA Decision · WildGuardTest average F1 | 95.4 | 93.1 |
| AA Decision cost per task v1.0 | 0 | 0 |
| AA Decision time per task v1.0 | 93 | 78 |
Specs
| Spec | D1 Ultra | Jev 1.14 |
|---|---|---|
| Input, per 1M | !$0.042 | !$0.042 |
| Context | 33K | 64K |
| Weights | Closed | Closed |
| Released | Oct 2026 | Oct 2026 |
| See images | ✓ | ✓ |
| Read PDFs | — | — |
| Hear audio | — | — |
| Watch video | — | — |
| Call tools | — | — |
| Force a tool call | ? | ? |
| Return strict JSON | Partial | Partial |
| Search the web | ? | ? |
| Run code | ? | ? |
| Use a computer | ? | ? |
What breaks when you switch
D1 Ultra → Jev 1.14
Nothing known.
Jev 1.14 → D1 Ultra