Gemma 2 9B It
Jun 2024
Gemma 2 9B ItCompare inon
Benchmarks of Gemma 2 9B It22
BenchmarkByScoreRank
Knowledge17
Math1
Writing1
Legacy · saturated or no longer reported3
No benchmark matches
Ranking?
Alternatives?
ModelScoreCostPer taskWhat changes
BetterGPT-5 Minihighwins 59%+1,733%$0.053OpenGemma 3 12Bunstatedwins 60%+67%$0.05 / $0.10Memory (4-bit): 4.6 GB → 6.1 GBBetterGPT-6 Lunamaxwins 70%+433%$0.068Function calling only with none · Chat Completions+3BetterGPT-5.6 Lunaxhighwins 70%+1,100%$0.085BetterGPT-5.6 Terraxhighwins 73%+11,900%$0.63Prompts with >272K input tokensModelScoreCostPer taskWhat changes
Nothing here yet.
ModelScoreCostPer taskWhat changes
GPT-5 Minihighwins 59%+1,733%$0.053GPT-6 Lunamaxwins 70%+433%$0.068Function calling only with none · Chat Completions+3GPT-5.6 Lunaxhighwins 70%+1,100%$0.085GPT-5.6 Terraxhighwins 73%+11,900%$0.63Prompts with >272K input tokensGPT-6.1 Solmaxwins 76%+10,567%$0.72Remove unsupported parameters+5ModelScoreCostPer taskWhat changes
Gemma 3 12BunstatedOpenwins 60%+67%$0.05 / $0.10Memory (4-bit): 4.6 GB → 6.1 GBGemma 3n E4B InstructunstatedOpenwins 56%——
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4Openwins 53%——Memory (4-bit): 4.6 GB → 11 GBGemma 3 4BunstatedOpenwins 52%+13%$0.04 / $0.05
Granite 4.1 8BunstatedOpensame——ModelScoreCostPer taskWhat changes
Gemini 4 Argonhighwins 81%—*$1.62Synchronous output stops at 65,536+2Gemini 3.8 Flashhighwins 79%—*$3.49Sampling parameters are ignored+1Gemini 3.1 Pro Previewunstatedwins 78%—$2 / $12Cannot use both thinking controlsGemini 3.6 Flashhighwins 77%—*$1.60Gemini 3 Flash Previewunstatedwins 76%—$0.50 / $3Gemini 2.5 Prounstatedwins 74%—$1.25 / $10Gemini 3.5 Flash Liteunstatedwins 73%—$0.30 / $2.50Gemma 4 31BunstatedOpenwins 72%—$0.10 / $0.34Memory (4-bit): 4.6 GB → 19 GBAll Google models →Run it yourself
estimateFits on✓ 8 GB (phone, laptop) · compressed✓ 16 GB · 8-bit✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceGemma termscommercial use with conditions
Benchmarks
all categoriesChat & Knowledge
Arena Text · overall1,267#171
Arena Text · Chinese1,185#179
Arena Text · English1,219.7#183
Arena Text · French1,190.2#149
Arena Text · German1,186.1#146
Arena Text · instruction following1,178.1#184
Arena Text · Japanese1,144.3#131
Arena Text · Korean1,136.6#142
Arena Text · non-English1,187.7#181
Arena Text · Russian1,200.3#177
Arena Text · Spanish1,200.3#153
EQ-Bench 3636.2#51
MATH Level 521#30
Arena Text · overall · October 22, 20261,207.4#174
Arena Text · overall · October 15, 20261,207.4#165
GPQA Diamond · Epoch27.5#124
MMLU-Pro · official board52.1#15
OTIS Mock AIME 2024 20250.6#127
Writing & Language
Arena Text · creative writing1,259#155
EQ-Bench Creative Writing v3839.7#84
FAQ
How much does Gemma 2 9B It cost?›
$0.03 per 1M input tokens and $0.06 per 1M output tokens (cheapest host: DeepInfra).
Is Gemma 2 9B It free to use?›
There is no free API; the cheapest paid price is $0.03 per 1M input tokens. The weights are open, so you can run it yourself.
How good is Gemma 2 9B It, and what is it best at?›
#183 of 205 in Chat & Knowledge, #167 of 197 in Writing & Language.
Is Gemma 2 9B It better than Jamba 1.5 Large?›
On Arena Text · creative writing, Gemma 2 9B It scores 1,259 vs 1,261 — about the same.
How can I use Gemma 2 9B It?›
Through the API of DeepInfra.
What is the context window of Gemma 2 9B It?›
8K tokens.
When was Gemma 2 9B It released? Is there a newer version?›
Released 2024-06-24. It is the current version in its line.
Is Gemma 2 9B It open source?›
Yes, the weights are open (gemma licence).
Can I run Gemma 2 9B It locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
Can Gemma 2 9B It read images?›
No, it accepts text only.
What is Gemma 2 9B It?›
Gemma 2 9B It is an open-weights language model from Google, released Jun 2024.
What are the best alternatives to Gemma 2 9B It?›
GPT-5 Mini (better), Gemma 3 12B (open weights).