Llama 3.2 3B Instruct

Sep 2024
Llama 3.2 3B Instruct
Compare in
on
—per task?
$0.02 / $0.02per 1M in / out?
—output speed?
131Kcontext

Rankingconfiguration unstated?

Alternatives?

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceLlama 3.2 licencecommercial use with conditions

FAQ

How much does Llama 3.2 3B Instruct cost?›

$0.02 per 1M input tokens and $0.02 per 1M output tokens (cheapest host: DeepInfra).

Is Llama 3.2 3B Instruct free to use?›

There is no free API; the cheapest paid price is $0.02 per 1M input tokens. The weights are open, so you can run it yourself.

How good is Llama 3.2 3B Instruct, and what is it best at?›

#188 of 196 in Chat & Knowledge, #34 of 39 in Agents & Tool Use, #186 of 195 in Writing & Language.

Is Llama 3.2 3B Instruct better than Phi 3 Medium 4K Instruct?›

On Arena Text · creative writing, Llama 3.2 3B Instruct scores 1,145 vs 1,150 — about the same.

How can I use Llama 3.2 3B Instruct?›

Through the API of Cloudflare, DeepInfra, Parasail.

What is the context window of Llama 3.2 3B Instruct?›

131K tokens, with up to 72K output tokens.

When was Llama 3.2 3B Instruct released? Is there a newer version?›

Released 2024-09-18. It is the current version in its line.

Is Llama 3.2 3B Instruct open source?›

Yes, the weights are open (llama3.2 licence).

Can I run Llama 3.2 3B Instruct locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

Can Llama 3.2 3B Instruct read images?›

No, it accepts text only.

What is Llama 3.2 3B Instruct?›

Llama 3.2 3B Instruct is an open-weights language model from Meta, released Sep 2024.

What are the best alternatives to Llama 3.2 3B Instruct?›

GPT-5 Mini (better), Gemma 3 12B (open weights).