Best for Agents & Tool Use
Agents & Tool Use benchmarks83
BenchmarkByLeaderModels
Agents28
Health & law1
Documents1
Reported by labs40
Legacy · saturated or no longer reported13
No benchmark matches
| Model | AutomationBench-AA | Per task | Price | Speed | Supports | Context |
|---|---|---|---|---|---|---|
77.5high | $1.99 | $2 / $10 | 84 | 1M | ||
72.5thinking | $0.22 | $0.15 / $0.60 | 105 | 1M | ||
71.8max | $5.46 | $2 / $10 | 137 | 1M | ||
71.3 | — | — | 1M | |||
69.5max | $5.98 | $4 / $20 | 96 | 1M | ||
68.5max | $3.26 | $10 / $50 | 69 | 1.05M | ||
68.1max | $4.52 | $4 / $20 | 161 | 1M | ||
67xhigh | $1.75 | $2 / $6 | 65 | 500K | ||
66.6max | $0.26 | $0.30 / $1.20 | 167 | 1M | ||
66.6xhigh | $0.39 | $2 / $10 | 53 | 1.05M | ||
65.6xhigh | $3.74 | $2 / $6 | 94 | 500K | ||
64.1thinking | $0.062 | $0.14 / $0.28 | 41 | 1M | ||
62.2max | $2.01 | $1.40 / $4.40 | 186 | 1M | ||
61.7 | $1.00 | $0.30 / $0.90 | 145 | 1M | ||
61.7xhigh | $0.52 | $2 / $10 | 117 | 1.05M | ||
60.9medium | $0.93 | $0.75 / $3.75 | — | 1M | ||
60.4max | $0.28 | $0.15 / $0.50 | 179 | 1M | ||
60.1max | $1.99 | $4 / $20 | 114 | 1.05M | ||
59.9thinking | $1.13 | $1.36 / $4.18 | 67 | 1M | ||
59.6max | $1.40 | $2 / $12 | 142 | 1.05M | ||
59.4max | $7.63 | $10 / $50 | 69 | 1M | ||
58.6thinking | $0.13 | $0.43 / $0.87 | 54 | 1M | ||
58.3max | $2.00 | $3 / $15 | 112 | 1M | ||
57.9high | $0.88 | $2 / $6 | 63 | 500K | ||
57.9max | $1.60 | $1.25 / $4.25 | 128 | 1M | ||
57.2thinking | $2.16 | $2 / $6 | 127 | 262K | ||
56.7max | $0.67 | $1.32 / $3.96 | 90 | 1M | ||
56.6max | $5.86 | $5 / $25 | 55 | 1M | ||
56.2thinking | $5.41 | $2 / $6 | 40 | 984K | ||
55.9thinking | $0.37 | $0.15 / $0.47 | 55 | 262K | ||
54.1max | $8.75 | $10 / $50 | 67 | 1M | ||
53.2max | $0.068 | $0.10 / $0.50 | 138 | 1.05M | ||
53high | $1.60 | $0.75 / $3.75 | 209 | 1M | ||
51thinking | $1.03 | $1 / $2.70 | 93 | 1M | ||
50.2max | $0.18 | $0.20 / $1.20 | 178 | 1.05M | ||
49.7xhigh | $0.84 | $1.25 / $4.25 | 126 | 1M | ||
48.5thinking | $0.57 | $0.25 / $1 | 333 | 1M | ||
48.2xhigh | $1.01 | $0.42 / $2.55 | 114 | 262K | ||
47.3xhigh | $2.63 | $5 / $30 | 113 | 1.05M | ||
46.5thinking | — | — | 262K | |||
45.6max | $4.08 | $5 / $25 | 66 | 1M | ||
40.6xhigh | $0.97 | $1.25 / $4.25 | 355 | 1M | ||
38.8xhigh | $1.38 | $1.25 / $4.25 | 280 | 1M | ||
37.2 | — | $1 / $4 | 1,109 | 524K | ||
36.5max | $5.09 | $2 / $10 | 80 | 1M | ||
36.4 | $0.69 | 167 | 400K | |||
36xhigh | $0.12 | $0.10 / $0.50 | 196 | 1M | ||
35.4thinking | $1.30 | $2 / $12 | 115 | 1M | ||
28.4max | $1.47 | $1.40 / $4.40 | 189 | 1M | ||
28.2 | $0.46 | $0.30 / $3 | — | 256K | ||
26.2xhigh | $0.45 | $0.75 / $4.50 | 307 | 400K | ||
26.1thinking | — | $1 / $4 | — | 524K | ||
25high | $0.19 | $0.30 / $2.50 | 454 | 1M | ||
24.5thinking | $0.54 | $0.95 / $4 | 63 | 256K | ||
23.9 | $2.02 | $0.60 / $1.80 | 166 | 1M | ||
23thinking | $1.15 | $1.48 / $4.43 | 201 | 1M | ||
22.3 | $0.37 | $0.05 / $0.20 | 129 | 524K | ||
21.3thinking | $0.51 | $0.30 / $1.20 | 157 | 524K | ||
20.9thinking | — | $0.30 / $1.20 | — | 524K | ||
20.3thinking | $1.02 | $1.40 / $4.40 | 72 | 203K |
