J

Gemma 2B Embeddings

Jun 2024
JGemma 2B Embeddings
Compare in
on
self-host onlyprice
7.9MTEB English v2
Jun 2024released
2,048Dimensions
8K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1Qwen 3 Embedding 8B61.82Qwen 3 Embedding 4B61.33F2LLM v2 14B60.84F2LLM v2 8B60.45F2LLM v2 4B59.9
···
64Arabic Mpnet Base All Nli Triplet29.865Gemma 2B Embeddings28.466Arabert All Nli Triplet Matryoshka28.4

Strong at

C
Embeddings & Retrieval#188 of 200

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
Licencenot verified

Benchmarks

in Embeddings & Retrieval
JMTEB v2 · Clustering · Japanese34.7#76
JMTEB v2 · STS · Japanese62.9#97
LongEmbed · Mean over tasks · English8.8#162
LongEmbed · Mean over task types · English8.8#162
LongEmbed · Retrieval · English8.8#162
MTEB German v1 · Classification · German53#79
MTEB German v1 · Pair Classification · German52.5#61
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)32.7#65
MTEB Europe v1 · Mean over task types · multilingual (29 languages)28.4#65
MTEB Europe v1 · Classification · multilingual (23 languages)50.3#88
MTEB Europe v1 · Instruction Reranking · English0.7#43
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)13.7#76
MTEB Europe v1 · STS · multilingual (8 languages)35.2#106
MTEB Europe v1 · Pair Classification · multilingual (11 languages)74.8#150
MTEB Europe v1 · Clustering · multilingual (29 languages)32.1#134
MTEB Europe v1 · Retrieval · multilingual (25 languages)13.1#144
MTEB Europe v1 · Reranking · multilingual (12 languages)29.8#174
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)6.1#179
MTEB French v1 · Mean over tasks · multilingual (2 languages)36#88
MTEB French v1 · Mean over task types · multilingual (2 languages)38#89
MTEB French v1 · STS · French48.5#108
MTEB French v1 · Retrieval · multilingual (2 languages)5.2#132
MTEB French v1 · Classification · French52.8#89
MTEB French v1 · Clustering · French36.7#84
MTEB French v1 · Reranking · French32.5#142
MTEB French v1 · Pair Classification · French59.1#79
MTEB French v1 · Summarization · French31.3#25
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)44.3#58
MTEB Indic v1 · Mean over task types · multilingual (25 languages)31.3#58
MTEB Indic v1 · Classification · multilingual (8 languages)58#55
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)0.9#160
MTEB Indic v1 · STS · multilingual (13 languages)8#111
MTEB Indic v1 · Reranking · multilingual (2 languages)60.2#104
MTEB Indic v1 · Retrieval · multilingual (14 languages)28.4#77
MTEB Indic v1 · Pair Classification · Hindi55.1#114
MTEB Indic v1 · Clustering · multilingual (21 languages)8.3#104
MTEB Dutch v1 · Reranking · Dutch53#199
MTEB Polish v1 · Mean over tasks · Polish50.5#45
MTEB Polish v1 · Mean over task types · Polish48.7#50
MTEB Polish v1 · Classification · Polish51.8#62
MTEB Polish v1 · Clustering · Polish30.7#58
MTEB Polish v1 · STS · Polish45.6#120
MTEB Polish v1 · Pair Classification · Polish66.7#88
MTEB Portuguese v1 · Multilabel Classification · Portuguese17.7#151
MTEB Law v1 · Mean over tasks · multilingual (3 languages)23.9#151
MTEB Law v1 · Mean over task types · multilingual (3 languages)23.9#151
MTEB Law v1 · Retrieval · multilingual (3 languages)23.9#151
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)16.2#128
MTEB Medical v1 · Mean over task types · multilingual (10 languages)23.1#115
MTEB Medical v1 · Retrieval · multilingual (10 languages)11.6#130
MTEB Medical v1 · Clustering · English32.5#171
MTEB Medical v1 · Reranking · Mandarin Chinese25.3#118
FollowIR · Mean over tasks · English0.7#43
FollowIR · Mean over task types · English0.7#43
FollowIR · Instruction Reranking · English0.7#43
MTEB Spanish v1 · Pair Classification · Spanish55.7#152
MTEB Thai v1 · Pair Classification · Thai56.1#104
MTEB Thai v1 · Clustering · Thai21.7#106
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)35.5#119
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)28.8#131
MTEB Scandinavian v1 · Classification · multilingual (6 languages)53.7#72
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)7.5#139
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)33.8#97
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)20.2#210
MTEB Russian v1.1 · Classification · Russian53.1#77
MTEB Russian v1.1 · Clustering · Russian39.5#91
MTEB Russian v1.1 · Multilabel Classification · Russian25.8#131
MTEB Russian v1.1 · Pair Classification · Russian52.5#113
RTEB French beta · Mean over tasks · multilingual (2 languages)0.1#218
RTEB German beta · Mean over tasks · German8.4#194
RTEB Law beta · Mean over tasks · multilingual (4 languages)17.4#202
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)37.3#90
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)29.6#91
MTEB multilingual v2 · Clustering · multilingual (208 languages)39.2#107
MTEB multilingual v2 · STS · multilingual (35 languages)36.8#119
MTEB multilingual v2 · Classification · multilingual (119 languages)54.6#68
MTEB multilingual v2 · Retrieval · multilingual (120 languages)13#170
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)16.2#112
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)4.2#177
MTEB multilingual v2 · Instruction Reranking · English0.7#43
MTEB multilingual v2 · Reranking · multilingual (22 languages)33.7#166
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)67.8#169

FAQ

How much does Gemma 2B Embeddings cost?›

There is no per-unit API price: self-host only.

Is Gemma 2B Embeddings free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Gemma 2B Embeddings, and what is it best at?›

#188 of 200 in Embeddings.

Is Gemma 2B Embeddings better than Arabic Mpnet Base All Nli Triplet?›

On MTEB Europe v1 · Mean over task types · multilingual (29 languages), Gemma 2B Embeddings scores 28.4 vs 29.8 — lower.

When was Gemma 2B Embeddings released? Is there a newer version?›

Released 2024-06-29. It is the current version in its line.

Is Gemma 2B Embeddings open source?›

Yes, the weights are open.

Can I run Gemma 2B Embeddings locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Gemma 2B Embeddings?›

Gemma 2B Embeddings is an open-weights embeddings & retrieval model from Jaume, released Jun 2024.

What are the best alternatives to Gemma 2B Embeddings?›

E5 Base v2 (better), Qwen 3 Embedding 8B (open weights).