Benchmarks of Olmo 3 7B Think13
BenchmarkByScoreRank
Overall1
Knowledge4
Science2
Coding1
Documents1
Legacy · saturated or no longer reported4
No benchmark matches
—per task?
self-host onlyprice
—output speed?
66Kcontext
Ranking?
Alternatives?
ModelScoreCostPer taskWhat changes
ModelScoreCostPer taskWhat changes
Nothing here yet.
ModelScoreCostPer taskWhat changes
ModelScoreCostPer taskWhat changes
SApriel v1.6 15B ThinkerOpen+25%——Memory (4-bit): 3.6 GB → 7.4 GBSApriel v1.5 15B ThinkerOpen+24%——Memory (4-bit): 3.6 GB → 7.4 GBModelScoreCostPer taskWhat changes
Run it yourself
estimateFits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use
Benchmarks
all categoriesChat & Knowledge
Humanity's Last Exam6#252
AA Omniscience Index-71.8#300
CritPt (physics)0#182
AA Intelligence Index 4.3.2≈5.6#310
AA Omniscience · Accuracy11.1#276
GPQA Diamond51.6#256
AIME 2025 · AA archived70.7#69
Coding
LiveCodeBench · AA archived61.7#70
Agents & Tool Use
τ²-bench · AA0#232
Writing & Language
IFBench (instructions)41.5#149
FAQ
How much does Olmo 3 7B Think cost?›
There is no per-unit API price: self-host only.
Is Olmo 3 7B Think free to use?›
There is no free API. The weights are open, so you can run it yourself.
How good is Olmo 3 7B Think, and what is it best at?›
#250 of 336 in Chat & Knowledge, #203 of 239 in Coding, #229 of 242 in Agents & Tool Use, #148 of 245 in Writing & Language.
Is Olmo 3 7B Think better than Ling 1T?›
On AIME 2025 · AA archived, Olmo 3 7B Think scores 70.7 vs 71.3 — about the same.
What is the context window of Olmo 3 7B Think?›
66K tokens.
When was Olmo 3 7B Think released? Is there a newer version?›
Released 2025-11-20. It is the current version in its line.
Is Olmo 3 7B Think open source?›
Yes, the weights are open (Apache-2.0 licence).
Can I run Olmo 3 7B Think locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
Can Olmo 3 7B Think read images?›
No, it accepts text only.
What is Olmo 3 7B Think?›
Olmo 3 7B Think is an open-weights language model from Allen Institute for AI, released Nov 2025.
What are the best alternatives to Olmo 3 7B Think?›
GPT OSS 20B (better), Apriel v1.6 15B Thinker (open weights).