Decider v1.2 vs Jev 1.13
| Benchmark | Decider v1.2 | Jev 1.13 |
|---|---|---|
| AA Decision Index v1.0 | 56.2 | 57.5 |
| AA Decision · Humanity's Last Exam text multiple-choice accuracy | 14.6 | 20.9 |
| AA Decision · Omniscience accuracy | 39.4 | 34.6 |
| AA Decision · Omniscience non-hallucination rate | 16.5 | 35.2 |
| AA Decision · When2Call accuracy | 87.7 | 80.7 |
| AA Decision · WildGuardTest average F1 | 94.4 | 93.6 |
| AA Decision cost per task v1.0 | 0 | 0 |
| AA Decision time per task v1.0 | 206 | 127 |
| Community Decision Index 0.4.1 | 68 | 59.2 |
Specs
| Spec | Decider v1.2 | Jev 1.13 |
|---|---|---|
| Input, per 1M | !$0.02 | !$0.042 |
| Context | 262K | 64K |
| Weights | Open | Closed |
| Released | Oct 2026 | Sep 2026 |
| Memory (4-bit) | 15 GB | — |
| Licence | Apache-2.0 | — |
| Commercial use | Allowed | — |
| See images | ✓ | ✓ |
| Read PDFs | — | — |
| Hear audio | — | — |
| Watch video | — | — |
| Call tools | — | — |
| Force a tool call | ? | ? |
| Return strict JSON | Partial | Partial |
| Search the web | ? | ? |
| Run code | ? | ? |
| Use a computer | ? | ? |
What breaks when you switch
Decider v1.2 → Jev 1.13
Context: 262K → 64K
Jev 1.13 → Decider v1.2
Nothing known.