Benchmarks of Olmo 3 7B Instruct13
BenchmarkByScoreRank
Overall1
Knowledge4
Science2
Coding1
Documents1
Legacy · saturated or no longer reported4
No benchmark matches
—per task?
price not verifiedprice
—output speed?
66Kcontext
Ranking?
Alternatives?
ModelScoreCostPer taskWhat changes
ModelScoreCostPer taskWhat changes
Nothing here yet.
ModelScoreCostPer taskWhat changes
ModelScoreCostPer taskWhat changes
SApriel v1.6 15B ThinkerOpen×2.1——Memory (4-bit): 3.6 GB → 7.4 GBSApriel v1.5 15B ThinkerOpen×2.1——Memory (4-bit): 3.6 GB → 7.4 GBModelScoreCostPer taskWhat changes
Run it yourself
estimateFits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use
Benchmarks
all categoriesChat & Knowledge
Humanity's Last Exam5.8#257
AA Omniscience Index-77.1#309
CritPt (physics)0#182
AA Intelligence Index 4.3.2≈5.2#315
AA Omniscience · Accuracy7.4#302
GPQA Diamond40#283
AIME 2025 · AA archived41.3#92
Coding
LiveCodeBench · AA archived26.6#129
Agents & Tool Use
τ²-bench · AA12.6#219
Writing & Language
IFBench (instructions)32.8#200
FAQ
How much does Olmo 3 7B Instruct cost?›
There is no per-unit API price: price not verified.
How good is Olmo 3 7B Instruct, and what is it best at?›
#255 of 336 in Chat & Knowledge, #210 of 239 in Coding, #216 of 242 in Agents & Tool Use, #198 of 245 in Writing & Language.
Is Olmo 3 7B Instruct better than Magistral Small 1?›
On AIME 2025 · AA archived, Olmo 3 7B Instruct scores 41.3 vs 41.3 — about the same.
What is the context window of Olmo 3 7B Instruct?›
66K tokens.
When was Olmo 3 7B Instruct released? Is there a newer version?›
Released 2025-11-20. It is the current version in its line.
Is Olmo 3 7B Instruct open source?›
Yes, the weights are open (Apache-2.0 licence).
Can I run Olmo 3 7B Instruct locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
Can Olmo 3 7B Instruct read images?›
No, it accepts text only.
What is Olmo 3 7B Instruct?›
Olmo 3 7B Instruct is an open-weights language model from Allen Institute for AI, released Nov 2025.
What are the best alternatives to Olmo 3 7B Instruct?›
GPT OSS 20B (better), Apriel v1.6 15B Thinker (open weights).