Llama 3.1 70B Instruct
Llama 3.1 70B InstructCompare inon
Benchmarks of Llama 3.1 70B Instruct19
BenchmarkByScoreRank
Math1
Writing15
Legacy · saturated or no longer reported3
No benchmark matches
Rankingconfiguration unstated?
Alternatives?
ModelScoreCostPer taskWhat changes
CheaperGLM 5.3 FlashunstatedOpenwins 73%-41%$0.15 / $0.50Memory (4-bit): 42 GB → 193 GB+5
BetterGPT-5 Minihighwins 59%+72%$0.053
OpenGemma 4 31Bunstatedwins 72%-60%$0.10 / $0.34
CheaperHy3unstatedOpenwins 72%-42%$0.13 / $0.53Memory (4-bit): 42 GB → 179 GBCheaperGPT-6 Lunamaxwins 71%-50%$0.068Function calling only with none · Chat Completions+3ModelScoreCostPer taskWhat changes
GLM 5.3 FlashunstatedOpenwins 73%-41%$0.15 / $0.50Memory (4-bit): 42 GB → 193 GB+5Hy3unstatedOpenwins 72%-42%$0.13 / $0.53Memory (4-bit): 42 GB → 179 GBGemma 4 31BunstatedOpenwins 72%-60%$0.10 / $0.34GPT-6 Lunamaxwins 71%-50%$0.068Function calling only with none · Chat Completions+3Gemma 4 26B A4BunstatedOpenwins 69%-34%$0.15 / $0.60ModelScoreCostPer taskWhat changes
GPT-5 Minihighwins 59%+72%$0.053GPT-6 Lunamaxwins 71%-50%$0.068Function calling only with none · Chat Completions+3GPT-5.6 Lunaxhighwins 71%+13%$0.085GPT-5.6 Terraxhighwins 73%+1,025%$0.63Prompts with >272K input tokensGPT-6.1 Solmaxwins 76%+900%$0.72Remove unsupported parameters+5ModelScoreCostPer taskWhat changes
Gemma 4 31BunstatedOpenwins 72%-60%$0.10 / $0.34
Mistral Medium 3.5unstatedOpenwins 69%+650%$1.50 / $7.50Memory (4-bit): 42 GB → 77 GBGemma 4 26B A4BunstatedOpenwins 69%-34%$0.15 / $0.60
Qwen3.8 27BunstatedOpenwins 65%+139%$0.42 / $2.55max_tokens range · QwenCloud+4Qwen 3.5 122B A10BunstatedOpenwins 65%+175%$0.40 / $3.20Memory (4-bit): 42 GB → 75 GBModelScoreCostPer taskWhat changes
Muse Wondermaxwins 79%—$4.52Only auto tool_choice is supported+5Muse Sparkunstatedwins 77%—$1.25 / $4.25Only n=1 · Meta / Chat Completions+1Muse Spark 1.3maxwins 76%—$1.60Only auto tool_choice is supported+5Muse Spark 1.2xhighwins 75%—$0.97Only auto tool_choice is supported+1Muse Spark 1.1unstatedwins 75%—$1.25 / $4.25Only n=1 · Meta / Chat Completions+1Muse Glimmer 30BunstatedOpenwins 65%—$0.30 / $1.10Llama 4 MaverickunstatedOpenwins 57%—$0.19 / $0.65Memory (4-bit): 42 GB → 241 GBLlama 4 ScoutunstatedOpenwins 55%—$0.10 / $0.30Memory (4-bit): 42 GB → 65 GBAll Meta models →Run it yourself
estimateFits on✗ 8 GB (phone, laptop)✗ 16 GB✗ 24 GB GPU✓ 48 GB GPU · compressed✓ 80 GB GPU · 8-bit
LicenceLlama 3.1 licencecommercial use with conditions
Benchmarks
all categoriesChat & Knowledge
Arena Text · overall1,293#158
Arena Text · Chinese1,215.2#156
Arena Text · English1,293.6#154
Arena Text · French1,261.3#126
Arena Text · German1,221.7#128
Arena Text · instruction following1,231.1#156
Arena Text · Japanese1,132.3#120
Arena Text · Korean1,140.5#129
Arena Text · non-English1,219.2#155
Arena Text · Russian1,233.6#154
Arena Text · Spanish1,253#135
MATH Level 536.7#25
Arena Text · overall · full cohort1,260.9#156
GPQA Diamond · Epoch44.2#109
OTIS Mock AIME 2024 20253.6#117
Writing & Language
Arena Text · creative writing1,257#156
EQ-Bench Creative Writing v3783.6#83
Arena Text · creative writing · full cohort1,231.7#153
FAQ
How much does Llama 3.1 70B Instruct cost?›
$0.40 per 1M input tokens and $0.40 per 1M output tokens (cheapest host: DeepInfra).
Is Llama 3.1 70B Instruct free to use?›
There is no free API; the cheapest paid price is $0.40 per 1M input tokens. The weights are open, so you can run it yourself.
How good is Llama 3.1 70B Instruct, and what is it best at?›
#158 of 196 in Chat & Knowledge, #156 of 195 in Writing & Language.
Is Llama 3.1 70B Instruct better than Gemma 2 9B It?›
On Arena Text · creative writing, Llama 3.1 70B Instruct scores 1,257 vs 1,259 — about the same.
How can I use Llama 3.1 70B Instruct?›
Through the API of Amazon Bedrock, DeepInfra.
What is the context window of Llama 3.1 70B Instruct?›
131K tokens, with up to 16K output tokens.
Is Llama 3.1 70B Instruct open source?›
Yes, the weights are open (llama3.1 licence).
Can I run Llama 3.1 70B Instruct locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
Can Llama 3.1 70B Instruct read images?›
No, it accepts text only.
What is Llama 3.1 70B Instruct?›
Llama 3.1 70B Instruct is an open-weights language model from Meta.
What are the best alternatives to Llama 3.1 70B Instruct?›
GLM 5.3 Flash (cheaper), GPT-5 Mini (better), Gemma 4 31B (open weights).