Benchmarks › Community Decision Index
Community Decision Index
Answer typed decision questions across five capability categories
68.9top score · mammoth-1 (27B)
99models ranked
97open-weights models
Full scorehigher is better
Oct 21, 2026last updated
How the test works
1
What it is
Answer typed decision questions across five capability categories
- Kinds of tasksDecision questions
- Number of items109,759 scoreable requests; 110,201 total requests across 42 benchmarks
2
Components
Private tests of the same skills 60%, Private tasks from new domains 40%
- How runs combineFull = 60% private same-skills + 40% private new-domains, mapped onto the public scale with stock models
3
Score
Full score
- Better isHigher
Sources: huggingface.co
Community Decision Index 0.4.1 leaderboardtop 10 of 99
Full leaderboard with filters →| Model | Community Decision Index 0.4.1 | Per task | Price | Speed | Supports | Context |
|---|---|---|---|---|---|---|
68.9 | — | $0 / — | — | 16K | ||
68 | — | $0.02 / — | — | 262K | ||
68 | — | — | 262K | |||
67.9 | — | — | 262K | |||
67.3 | — | — | 33K | |||
67.2 | — | — | 262K | |||
66.9 | — | — | 262K | |||
66.6 | — | — | 262K | |||
64.8 | — | — | 131K | |||
64.4 | — | — | 262K |
Community Decision Index questions
What is Community Decision Index?›
Answer typed decision questions across five capability categories. It has 109,759 scoreable requests; 110,201 total requests across 42 benchmarks. Created by Jev Decision Index community (multimodalart).
Which model is best on Community Decision Index?›
mammoth-1 (27B) leads Community Decision Index 0.4.1 with 68.9, ahead of Decider v1.2 (68) and AutoTrust-JEV-27B v1.1 (68).
What is the best open-weights model on Community Decision Index?›
mammoth-1 (27B) with 68.9, then Decider v1.2 (68).
How is Community Decision Index scored?›
Full score; 60% private same-skills + 40% private new-domains, mapped to public scale.