Llama 4 Scout

Apr 2025
Llama 4 Scout
Compare in
on
$0.11per task?
$0.10 / $0.30per 1M in / out?
82 tok/sfirst token in 0.8 s?
10Mcontext

Rankingin non-thinking mode?

Strong at

C
Coding#75 of 132Agents & work tasks#122 of 175Tool calling#207 of 242Reasoning#315 of 334Science#229 of 312Long context#222 of 273Knowledge#220 of 318Instructions#160 of 245Vision#106 of 124

Alternatives?

ModelScoreCostPer taskWhat changes
CheaperGemma 3 27BunstatedOpenwins 58%-33%$0.08 / $0.16Context: 10M → 131KBetterGPT-5 Minihighwins 55%+358%$0.053Context: 10M → 400KOpenGemma 4 31Bunstatedwins 68%+7%$0.10 / $0.34Context: 10M → 256KCheaperQwen 3.5 Flashunstatedwins 57%-24%$0.065 / $0.26Context: 10M → 1MCheaperGemma 3 12BunstatedOpenwins 56%-58%$0.05 / $0.10Context: 10M → 131K

Run it yourself

estimate
Fits on✗ 8 GB (phone, laptop)✗ 16 GB✗ 24 GB GPU✗ 48 GB GPU✓ 80 GB GPU · compressed
LicenceLlama 4 licencecommercial use with conditions

Benchmarks

all categories
Chat & Knowledge
Humanity's Last Exam3.8#318
AA Omniscience Index-52.2#221
CritPt (physics)0#180
AA Intelligence Index 4.3.26.5#289
AA Omniscience · Accuracy15.2#232
AA Omniscience · Hallucination Rate79.4#161
AA-LCR (long context) 1.127.7#224
GDP.pdf · AA all-pass0#131
MMLU-Pro · official boardlab74.3
GPQA Diamond58.7#232
AIME 2025 · AA archived14#121
Coding
Terminal-Bench 4.00#75
SciCode21.3#135
Terminal-Bench Hard (version unstated)1.5#197
Terminal-Bench 2.13.7#140
LiveCodeBench · AA archived29.9#121
Agents & Tool Use
AutomationBench-AA0.2#131
GDPval-AA (work tasks) 2.10#122
τ³-Banking · AA3.3#131
AA-Briefcase 1.1 · Elo0#129
τ²-bench · AA15.5#210
Writing & Language
IFBench (instructions)39.5#161
Vision & Documents
MMMU-Pro (vision)52.9#109

FAQ

How much does Llama 4 Scout cost?›

$0.10 per 1M input tokens and $0.30 per 1M output tokens (cheapest host: DeepInfra). A typical benchmark task costs about $0.11 at default effort.

Is Llama 4 Scout free to use?›

There is no free API; the cheapest paid price is $0.10 per 1M input tokens. The weights are open, so you can run it yourself.

How good is Llama 4 Scout, and what is it best at?›

#315 of 334 in Chat & Knowledge, #75 of 132 in Coding, #131 of 133 in Agents & Tool Use, #138 of 195 in Writing & Language, #106 of 124 in Vision & Documents.

Is Llama 4 Scout better than QwQ 32B?›

On Arena Text · creative writing, Llama 4 Scout scores 1,289 vs 1,293 — about the same.

How can I use Llama 4 Scout?›

Through the API of DeepInfra, Google, Novita.

What is the context window of Llama 4 Scout?›

10M tokens, with up to 16K output tokens.

When was Llama 4 Scout released? Is there a newer version?›

Released 2025-04-05. It is the current version in its line.

Is Llama 4 Scout open source?›

Yes, the weights are open (llama4 licence).

Can I run Llama 4 Scout locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

Can Llama 4 Scout read images?›

It accepts text and images as input.

What is Llama 4 Scout?›

Llama 4 Scout is an open-weights language model from Meta, released Apr 2025.

What are the best alternatives to Llama 4 Scout?›

Gemma 3 27B (cheaper), GPT-5 Mini (better), Gemma 4 31B (open weights).