Granite 4.1 8B
Apr 2026
Granite 4.1 8BCompare inon
Granite 4.1 8B measured on 17 of 109 Chat & Knowledge benchmarks17
BenchmarkByScoreRank
Overall1
Knowledge12
Science2
Documents1
Legacy · saturated or no longer reported1
No benchmark matches
—per task?
self-host onlyprice
—output speed?
131Kcontext
Alternatives?
ModelScoreCostPer taskWhat changes
BetterGPT-6 Lunalow+3%—$0.005Function calling only with none · Chat Completions+3OOpenMiniCPM5 1Bnon-thinking×96.7——BetterGranite 4.2 3BthinkingOpen×3.3—$0.006Context: 131K → 128K
BetterMinistral 3 3B 2512Open+9%—$0.008
BetterGemma 4 E4BthinkingOpen×2.8—$0.008Context: 131K → 128KModelScoreCostPer taskWhat changes
Nothing here yet.
ModelScoreCostPer taskWhat changes
GPT-6 Lunalow+3%—$0.005Function calling only with none · Chat Completions+3Granite 4.2 3BthinkingOpen×3.3—$0.006Context: 131K → 128KMinistral 3 3B 2512Open+9%—$0.008Gemma 4 E4BthinkingOpen×2.8—$0.008Context: 131K → 128KGPT-5.6 Lunanon-thinking+16%—$0.01ModelScoreCostPer taskWhat changes
OMiniCPM5 1Bnon-thinkingOpen×96.7——AG9v3 3BOpen×7.5——lLFM2.5 2.6BthinkingOpen×5.4—$0.35 / $0.50OMiniCPM5 2BthinkingOpen×4——Granite 4.2 3BthinkingOpen×3.3—$0.006Context: 131K → 128KModelScoreCostPer taskWhat changes
Granite 4.0 Micronon-thinkingOpen-9%—$0.017 / $0.11Granite 4.1 3BOpen-8%——Granite 4.1 30BOpen-8%—$0.10 / $0.25Memory (4-bit): 4.4 GB → 17 GBGranite 4.0 1Bnon-thinkingOpen-7%——Context: 131K → 128KGranite 4.0 H 350MOpensame——Context: 131K → 33KGranite 4.0 H Smallnon-thinkingOpensame—$0.05 / $0.22Context: 131K → 128K+1Granite 4.0 H 1BOpen+7%——Context: 131K → 128KGranite 4.0 350Mnon-thinkingOpen+14%——Context: 131K → 33KAll IBM models →Run it yourself
estimateFits on✓ 8 GB (phone, laptop) · compressed✓ 16 GB · 8-bit✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use
History
2 versionsBenchmarks
in Chat & KnowledgeAA Intelligence Index 4.3.2≈6.6#287
AA Omniscience Index-64.1#282
AA Omniscience · Accuracy12.3#267
Humanity's Last Exam3.8#318
GPQA Diamond43.3#272
AA-LCR (long context) 1.113.3#256
IFBench (instructions)38.6#166
CritPt (physics)0#182
FAQ
How much does Granite 4.1 8B cost?›
There is no per-unit API price: self-host only.
Is Granite 4.1 8B free to use?›
There is no free API. The weights are open, so you can run it yourself.
How good is Granite 4.1 8B, and what is it best at?›
#315 of 336 in Chat & Knowledge, #95 of 97 in Coding, #155 of 242 in Agents & Tool Use, #151 of 197 in Writing & Language.
Is Granite 4.1 8B better than Qwen 3.5 122B A10B?›
On AA Omniscience · Hallucination Rate, Granite 4.1 8B scores 87.1 vs 87.1 — about the same.
What is the context window of Granite 4.1 8B?›
131K tokens.
When was Granite 4.1 8B released? Is there a newer version?›
Released 2026-04-29. It has been superseded by Granite 4.2 8B.
Is Granite 4.1 8B open source?›
Yes, the weights are open (Apache-2.0 licence).
Can I run Granite 4.1 8B locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
Can Granite 4.1 8B read images?›
No, it accepts text only.
What is Granite 4.1 8B?›
Granite 4.1 8B is an open-weights language model from IBM, released Apr 2026.
What are the best alternatives to Granite 4.1 8B?›
GPT-6 Luna (better), MiniCPM5 1B (open weights).