Best for Agents & Tool Use
Agents & Tool Use benchmarks83
BenchmarkByLeaderModels
Agents28
Health & law1
Documents1
Reported by labs40
Legacy · saturated or no longer reported13
No benchmark matches
| Model | ITBench SRE | Per task | Price | Speed | Supports | Context |
|---|---|---|---|---|---|---|
56.2max | $1.99 | $4 / $20 | 114 | 1.05M | ||
55.6thinking | $1.03 | $1 / $2.70 | 93 | 1M | ||
52.5high | $1.24 | $0.75 / $3.75 | 149 | 1M | ||
51.2max | $0.28 | $0.15 / $0.50 | 179 | 1M | ||
51max | $1.40 | $2 / $12 | 142 | 1.05M | ||
49.5max | $7.63 | $10 / $50 | 69 | 1M | ||
49.4max | $1.04 | $2 / $10 | 128 | 1.05M | ||
48.6max | $3.26 | $10 / $50 | 69 | 1.05M | ||
47.7max | $2.00 | $3 / $15 | 112 | 1M | ||
46.7max | — | $5 / $25 | 63 | 1M | ||
46.1max | $2.01 | $1.40 / $4.40 | 186 | 1M | ||
45.8xhigh | $2.63 | $5 / $30 | 113 | 1.05M | ||
42.7max | $1.47 | $1.40 / $4.40 | 189 | 1M | ||
42.5thinking | $1.15 | $1.48 / $4.43 | 201 | 1M | ||
42.1xhigh | $3.74 | $2 / $6 | 94 | 500K | ||
40.3max | $0.18 | $0.20 / $1.20 | 178 | 1.05M | ||
40.3thinking | $1.02 | $1.40 / $4.40 | 72 | 203K | ||
40.3thinking | $5.41 | $2 / $6 | 40 | 984K | ||
39.8max | $2.49 | $3 / $15 | 62 | 1M | ||
38.2max | $5.98 | $4 / $20 | 96 | 1M | ||
38.2thinking | $0.054 | $0.43 / $0.87 | 46 | 1M | ||
37.3thinking | — | $0.10 / $0.34 | 55 | 256K | ||
35.5thinking | — | $0.30 / $2.40 | 62 | 262K | ||
35.2xhigh | $0.45 | $0.75 / $4.50 | 307 | 400K | ||
34.1thinking | $0.47 | $0.60 / $3.60 | 55 | 262K | ||
33.2max | $1.60 | $1.25 / $4.25 | 128 | 1M | ||
32.7high | $0.21 | $1.25 / $2.50 | 188 | 1M | ||
31.2thinking | $0.80 | $0.95 / $4 | 109 | 256K | ||
30.3thinking | $1.30 | $2 / $12 | 115 | 1M | ||
30.3high | — | $0.20 / $1.15 | 123 | 256K | ||
27.3thinking | $0.28 | $1 / $5 | 105 | 200K | ||
26.5thinking | — | $0.30 / $1.20 | 70 | 205K | ||
24.4xhigh | $0.18 | $0.20 / $1.25 | 163 | 400K | ||
23.6thinking | — | $0.15 / $0.60 | 55 | 256K | ||
21.5thinking | — | $0.25 / $2 | 81 | 262K | ||
5.6high | $0.092 | $0.03 / $0.15 | 243 | 131K | ||
1.1 | $1.64 | $0.13 / $1.15 | 148 | 1M |