Llama 3.1 405B Instruct
Jul 2024
Llama 3.1 405B InstructCompare inon
Benchmarks of Llama 3.1 405B Instruct4
BenchmarkByScoreRank
Legacy · saturated or no longer reported3
No benchmark matches
—per task?
price not verifiedprice
—output speed?
128Kcontext
Ranking?
Alternatives?
ModelScoreCostPer taskWhat changes
BetterMuse Spark 1.1unstated×5.5—$1.25 / $4.25Only n=1 · Meta / Chat Completions+1
OpenQwen3 Coder 480B A35Bunstated×3.5—$0.22 / $1.80
BetterGPT-5.4xhigh×5.3—$2.50 / $15BetterMuse Sparkunstated×4.9—$1.25 / $4.25Only n=1 · Meta / Chat Completions+1
BetterClaude Opus 4.6unstated×4.6—$5 / $25ModelScoreCostPer taskWhat changes
Nothing here yet.
ModelScoreCostPer taskWhat changes
Muse Spark 1.1unstated×5.5—$1.25 / $4.25Only n=1 · Meta / Chat Completions+1GPT-5.4xhigh×5.3—$2.50 / $15Muse Sparkunstated×4.9—$1.25 / $4.25Only n=1 · Meta / Chat Completions+1Claude Opus 4.6unstated×4.6—$5 / $25
Gemini 3.1 Prounstated×4.1—$2 / $12ModelScoreCostPer taskWhat changes
Qwen3 Coder 480B A35BunstatedOpen×3.5—$0.22 / $1.80
Kimi K2 0711unstatedOpen×2.5—$0.50 / $2Qwen3 235B A22BunstatedOpen+92%—$0.70 / $2.80Context: 128K → 33KGPT OSS 120BunstatedOpen+45%—$0.03 / $0.15Gemma 3 27BunstatedOpensame—$0.08 / $0.16ModelScoreCostPer taskWhat changes
Muse Spark 1.1unstated×5.5—$1.25 / $4.25Only n=1 · Meta / Chat Completions+1Muse Sparkunstated×4.9—$1.25 / $4.25Only n=1 · Meta / Chat Completions+1Llama 4 Maverick 17B Instruct-53%——Muse Spark OpenxhighOpenn/a—$0.84Reasoning off leaves output unchanged · Self-hosted / llama.cpp+1Muse Wondermaxn/a—$4.52Only auto tool_choice is supported+5Muse Wonder Fulln/a——Only in Muse CodeMuse Spark 1.3xhighn/a—$1.37Only auto tool_choice is supported+5Muse Glimmer 30BhighOpenn/a—$0.058All Meta models →Benchmarks
all categoriesChat & Knowledge
MATH Level 549.8#21
MMLU-Pro · official boardlab73.3
GPQA Diamond · Epoch50.9#102
OTIS Mock AIME 2024 20259.7#107
Coding
SWE-bench Pro (public)11.2#18
FAQ
How much does Llama 3.1 405B Instruct cost?›
There is no per-unit API price: price not verified.
How good is Llama 3.1 405B Instruct, and what is it best at?›
#102 of 133 in Chat & Knowledge, #18 of 19 in Coding, #18 of 19 in Agents & Tool Use.
Is Llama 3.1 405B Instruct better than Gemma 3 27B?›
On SWE-bench Pro (public), Llama 3.1 405B Instruct scores 11.2 vs 11.4 — about the same.
What is the context window of Llama 3.1 405B Instruct?›
128K tokens.
When was Llama 3.1 405B Instruct released? Is there a newer version?›
Released 2024-07-23. It is the current version in its line.
What is Llama 3.1 405B Instruct?›
Llama 3.1 405B Instruct is a language model from Meta, released Jul 2024.
What are the best alternatives to Llama 3.1 405B Instruct?›
Muse Spark 1.1 (better), Qwen3 Coder 480B A35B (open weights).