Llama 3.1 405B Instruct
Jul 2024
Llama 3.1 405B InstructCompare inon
Benchmarks of Llama 3.1 405B Instruct4
BenchmarkByScoreRank
Legacy · saturated or no longer reported3
No benchmark matches
—per task?
price not verifiedprice
—output speed?
128Kcontext
Ranking?
Alternatives?
ModelScoreCostPer taskWhat changes
BetterGPT-5.6 Lunalow+62%—$0.01
OpenKimi K3max+83%—$2.00Sampling parameters are fixed+3
BetterGemini 3.1 Flash Litehigh+61%—$0.06BetterGPT-6 Lunamax+78%—$0.068Function calling only with none · Chat Completions+3BetterGPT OSS 120BhighOpen+49%—$0.092ModelScoreCostPer taskWhat changes
Nothing here yet.
ModelScoreCostPer taskWhat changes
GPT-5.6 Lunalow+62%—$0.01Gemini 3.1 Flash Litehigh+61%—$0.06GPT-6 Lunamax+78%—$0.068Function calling only with none · Chat Completions+3GPT OSS 120BhighOpen+49%—$0.092GPT-5.6 Terralow+72%—$0.14Prompts with >272K input tokensModelScoreCostPer taskWhat changes
Kimi K3maxOpen+83%—$2.00Sampling parameters are fixed+3
GLM 5.2maxOpen+80%—$1.47
DeepSeek V4 Pro 0813maxOpen+80%—$0.67Pass back reasoning_content · Chat Completions+4
MiniMax M3unstatedOpen+79%—$0.30 / $1.20Deployment status experimental · Self-hostedGLM 5.3maxOpen+79%—$2.01Reasoning cannot be disabled+3ModelScoreCostPer taskWhat changes
Muse Sparkunstated+76%—$1.25 / $4.25Only n=1 · Meta / Chat Completions+1Muse Spark Open 816B A42B+74%—$1.25 / $4.25Context: not verifiedLlama 4 Maverick 17B 128E Instruct FP8Open+32%—$0.20 / $0.80Llama 4 ScoutunstatedOpensame—$0.10 / $0.30Llama 3.3 70B InstructunstatedOpen-7%—$0.10 / $0.32Llama 3.1 70B InstructunstatedOpen-13%—$0.40 / $0.40Llama 3.2 90B Vision InstructOpen-19%—$0.35 / $0.40Context: 128K → 33KMeta Llama 3 70B InstructOpen-20%—$0.30 / $0.40Context: 128K → 8KAll Meta models →Benchmarks
all categoriesChat & Knowledge
MATH Level 549.8#21
MMLU-Pro · official boardlab73.3
GPQA Diamond · Epoch50.9#102
OTIS Mock AIME 2024 20259.7#107
Coding
SWE-bench Pro (public)11.2#18
FAQ
How much does Llama 3.1 405B Instruct cost?›
There is no per-unit API price: price not verified.
How good is Llama 3.1 405B Instruct, and what is it best at?›
#102 of 133 in Chat & Knowledge, #18 of 19 in Coding, #18 of 19 in Agents & Tool Use.
Is Llama 3.1 405B Instruct better than Llama 4 Scout?›
On GPQA Diamond · Epoch, Llama 3.1 405B Instruct scores 50.9 vs 51.8 — about the same.
What is the context window of Llama 3.1 405B Instruct?›
128K tokens.
When was Llama 3.1 405B Instruct released? Is there a newer version?›
Released 2024-07-23. It is the current version in its line.
What is Llama 3.1 405B Instruct?›
Llama 3.1 405B Instruct is a language model from Meta, released Jul 2024.
What are the best alternatives to Llama 3.1 405B Instruct?›
GPT-5.6 Luna (better), Kimi K3 (open weights).