KaLM Embedding Gemma3 12B 2511 vs Llama Embed Nemotron 8B
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages) Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs, rank relevant documents for queries, find translated sentence pairs, rerank documents according to instructions, assign multiple labels to each example, reorder candidate documents by relevance on MTEB Multilingual v2 · mean over tasks in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; tasks receive equal weight
KaLM Embedding Gemma3 12B 251172.3
Llama Embed Nemotron 8B69.5
FollowIR · Mean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight
KaLM Embedding Gemma3 12B 25115.5
Llama Embed Nemotron 8B10.8
FollowIR · Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight
KaLM Embedding Gemma3 12B 25115.5
Llama Embed Nemotron 8B10.8
FollowIR · Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English
KaLM Embedding Gemma3 12B 25115.5
Llama Embed Nemotron 8B10.8
MTEB Europe v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian
KaLM Embedding Gemma3 12B 251192.8
Llama Embed Nemotron 8B92.1
MTEB Europe v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian
KaLM Embedding Gemma3 12B 251150.7
Llama Embed Nemotron 8B49.9
MTEB Europe v1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English
KaLM Embedding Gemma3 12B 25115.5
Llama Embed Nemotron 8B10.8
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish
KaLM Embedding Gemma3 12B 251125.2
Llama Embed Nemotron 8B22
MTEB Europe v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish
KaLM Embedding Gemma3 12B 251163.1
Llama Embed Nemotron 8B62.5
MTEB French v1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French
KaLM Embedding Gemma3 12B 251169.2
Llama Embed Nemotron 8B66.8
MTEB Indic v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu
KaLM Embedding Gemma3 12B 251152.9
Llama Embed Nemotron 8B57
MTEB Indic v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi
KaLM Embedding Gemma3 12B 251182.5
Llama Embed Nemotron 8B80.1
MTEB Indic v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi
KaLM Embedding Gemma3 12B 251187.6
Llama Embed Nemotron 8B88.5
MTEB Indic v1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu
KaLM Embedding Gemma3 12B 251163.4
Llama Embed Nemotron 8B58.2
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages) Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs, rank relevant documents for queries, find translated sentence pairs, rerank documents according to instructions, assign multiple labels to each example, reorder candidate documents by relevance on MTEB Multilingual v2 · mean over task types in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; task types receive equal weight
KaLM Embedding Gemma3 12B 251162.5
Llama Embed Nemotron 8B61.1
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi
KaLM Embedding Gemma3 12B 251183.8
Llama Embed Nemotron 8B81.7
MTEB multilingual v2 · Classification · multilingual (119 languages) Embeddings assign examples to categories on MTEB Multilingual v2 · Classification in 119 languages including Achinese, Afrikaans, Albanian, Algerian Arabic, Amharic, Arabic, Armenian, Assamese
KaLM Embedding Gemma3 12B 251177.9
Llama Embed Nemotron 8B73.2
MTEB multilingual v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian
KaLM Embedding Gemma3 12B 251155.8
Llama Embed Nemotron 8B54.4
MTEB multilingual v2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English
KaLM Embedding Gemma3 12B 25115.5
Llama Embed Nemotron 8B10.8
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish
KaLM Embedding Gemma3 12B 251133
Llama Embed Nemotron 8B29.9
MTEB multilingual v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French
KaLM Embedding Gemma3 12B 251184.7
Llama Embed Nemotron 8B84
MTEB multilingual v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French
KaLM Embedding Gemma3 12B 251167.3
Llama Embed Nemotron 8B67.8
MTEB multilingual v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali
KaLM Embedding Gemma3 12B 251175.7
Llama Embed Nemotron 8B68.7
MTEB multilingual v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English
KaLM Embedding Gemma3 12B 251179
Llama Embed Nemotron 8B79.4
MTEB Dutch v1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch
KaLM Embedding Gemma3 12B 251190.5
Llama Embed Nemotron 8B91.7
MTEB Portuguese v1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese
KaLM Embedding Gemma3 12B 251131.6
Llama Embed Nemotron 8B29
MTEB Russian v1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian
KaLM Embedding Gemma3 12B 251161.6
Llama Embed Nemotron 8B67.2
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk
KaLM Embedding Gemma3 12B 251182.7
Llama Embed Nemotron 8B79.6
MTEB Spanish v1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish
KaLM Embedding Gemma3 12B 251177.7
Llama Embed Nemotron 8B74.8
MTEB Thai v1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai
KaLM Embedding Gemma3 12B 251157.2
Llama Embed Nemotron 8B63.4
MTEB Thai v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai
KaLM Embedding Gemma3 12B 251185.1
Llama Embed Nemotron 8B81.4
MTEB Korean v2 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Korean v2 · Retrieval in English, Korean
KaLM Embedding Gemma3 12B 2511—
Llama Embed Nemotron 8B56.3
MTEB Dutch v1 · Mean over tasks · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over tasks in Dutch; tasks receive equal weight
KaLM Embedding Gemma3 12B 2511—
Llama Embed Nemotron 8B66.2
MTEB Dutch v1 · Mean over task types · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over task types in Dutch; task types receive equal weight
KaLM Embedding Gemma3 12B 2511—
Llama Embed Nemotron 8B70.7
MTEB Dutch v1 · Classification · Dutch Embeddings assign examples to categories on MTEB Dutch v1 · Classification in Dutch
KaLM Embedding Gemma3 12B 2511—
Llama Embed Nemotron 8B73.4
MTEB Dutch v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch
KaLM Embedding Gemma3 12B 2511—
Llama Embed Nemotron 8B50.8
MTEB Dutch v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch
KaLM Embedding Gemma3 12B 2511—
Llama Embed Nemotron 8B41.5
MTEB Dutch v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch
KaLM Embedding Gemma3 12B 2511—
Llama Embed Nemotron 8B83.9
MTEB Dutch v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch
KaLM Embedding Gemma3 12B 2511—
Llama Embed Nemotron 8B67
MTEB Dutch v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch
KaLM Embedding Gemma3 12B 2511—
Llama Embed Nemotron 8B86.4
MTEB Thai v1 · Mean over tasks · multilingual (2 languages) Embeddings group similar examples, assign examples to categories, classify relationships between pairs, rank relevant documents for queries, reorder candidate documents by relevance on MTEB Thai v1 · mean over tasks in English, Thai; tasks receive equal weight
KaLM Embedding Gemma3 12B 251166.4
Llama Embed Nemotron 8B—
MTEB Thai v1 · Mean over task types · multilingual (2 languages) Embeddings group similar examples, assign examples to categories, classify relationships between pairs, rank relevant documents for queries, reorder candidate documents by relevance on MTEB Thai v1 · mean over task types in English, Thai; task types receive equal weight
KaLM Embedding Gemma3 12B 251166.8
Llama Embed Nemotron 8B—
MTEB Thai v1 · Classification · Thai Embeddings assign examples to categories on MTEB Thai v1 · Classification in Thai
KaLM Embedding Gemma3 12B 251176.2
Llama Embed Nemotron 8B—
MTEB Thai v1 · Reranking · Thai Embeddings reorder candidate documents by relevance on MTEB Thai v1 · Reranking in Thai
KaLM Embedding Gemma3 12B 251151.7
Llama Embed Nemotron 8B—
MTEB Thai v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Thai v1 · Retrieval in English, Thai
KaLM Embedding Gemma3 12B 251163.7
Llama Embed Nemotron 8B—
| Benchmark | KaLM Embedding Gemma3 12B 2511 | Llama Embed Nemotron 8B |
|---|---|---|
| MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages) | 72.3 | 69.5 |
| FollowIR · Mean over tasks · English | 5.5 | 10.8 |
| FollowIR · Mean over task types · English | 5.5 | 10.8 |
| FollowIR · Instruction Reranking · English | 5.5 | 10.8 |
| MTEB Europe v1 · Bitext Mining · multilingual (28 languages) | 92.8 | 92.1 |
| MTEB Europe v1 · Clustering · multilingual (29 languages) | 50.7 | 49.9 |
| MTEB Europe v1 · Instruction Reranking · English | 5.5 | 10.8 |
| MTEB Europe v1 · Multilabel Classification · multilingual (23 languages) | 25.2 | 22 |
| MTEB Europe v1 · Reranking · multilingual (12 languages) | 63.1 | 62.5 |
| MTEB French v1 · Pair Classification · French | 69.2 | 66.8 |
| MTEB Indic v1 · Clustering · multilingual (21 languages) | 52.9 | 57 |
| MTEB Indic v1 · Pair Classification · Hindi | 82.5 | 80.1 |
| MTEB Indic v1 · Reranking · multilingual (2 languages) | 87.6 | 88.5 |
| MTEB Indic v1 · STS · multilingual (13 languages) | 63.4 | 58.2 |
| MTEB multilingual v2 · Mean over task types · multilingual (1037 languages) | 62.5 | 61.1 |
| MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages) | 83.8 | 81.7 |
| MTEB multilingual v2 · Classification · multilingual (119 languages) | 77.9 | 73.2 |
| MTEB multilingual v2 · Clustering · multilingual (208 languages) | 55.8 | 54.4 |
| MTEB multilingual v2 · Instruction Reranking · English | 5.5 | 10.8 |
| MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages) | 33 | 29.9 |
| MTEB multilingual v2 · Pair Classification · multilingual (24 languages) | 84.7 | 84 |
| MTEB multilingual v2 · Reranking · multilingual (22 languages) | 67.3 | 67.8 |
| MTEB multilingual v2 · Retrieval · multilingual (120 languages) | 75.7 | 68.7 |
| MTEB multilingual v2 · STS · multilingual (35 languages) | 79 | 79.4 |
| MTEB Dutch v1 · Reranking · Dutch | 90.5 | 91.7 |
| MTEB Portuguese v1 · Multilabel Classification · Portuguese | 31.6 | 29 |
| MTEB Russian v1.1 · Pair Classification · Russian | 61.6 | 67.2 |
| MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages) | 82.7 | 79.6 |
| MTEB Spanish v1 · Pair Classification · Spanish | 77.7 | 74.8 |
| MTEB Thai v1 · Clustering · Thai | 57.2 | 63.4 |
| MTEB Thai v1 · Pair Classification · Thai | 85.1 | 81.4 |
| MTEB Korean v2 · Retrieval · multilingual (2 languages) | — | 56.3 |
| MTEB Dutch v1 · Mean over tasks · Dutch | — | 66.2 |
| MTEB Dutch v1 · Mean over task types · Dutch | — | 70.7 |
| MTEB Dutch v1 · Classification · Dutch | — | 73.4 |
| MTEB Dutch v1 · Clustering · Dutch | — | 50.8 |
| MTEB Dutch v1 · Multilabel Classification · Dutch | — | 41.5 |
| MTEB Dutch v1 · Pair Classification · Dutch | — | 83.9 |
| MTEB Dutch v1 · Retrieval · Dutch | — | 67 |
| MTEB Dutch v1 · STS · Dutch | — | 86.4 |
| MTEB Thai v1 · Mean over tasks · multilingual (2 languages) | 66.4 | — |
| MTEB Thai v1 · Mean over task types · multilingual (2 languages) | 66.8 | — |
| MTEB Thai v1 · Classification · Thai | 76.2 | — |
| MTEB Thai v1 · Reranking · Thai | 51.7 | — |
| MTEB Thai v1 · Retrieval · multilingual (2 languages) | 63.7 | — |
Specs
| Spec | KaLM Embedding Gemma3 12B 2511 | Llama Embed Nemotron 8B |
|---|---|---|
| Context | 33K | 33K |
| Weights | Open | Open |
| Released | Nov 2025 | Oct 2025 |
| Dimensions | 3,840 | 4,096 |
| Max input | 131K tokens | 131K tokens |
| Memory (4-bit) | 7.1 GB | 4.5 GB |
| Licence | tencent-kalm-embedding-community | https://huggingface.co/nvidia/llama-embed-nemotron-8b/blob/main/LICENSE |
| Commercial use | Restricted | Restricted |
What breaks when you switch
KaLM Embedding Gemma3 12B 2511 → Llama Embed Nemotron 8B
Re-embed your whole corpus›
Vectors from different models can't be mixed; dimensions change from 3,840 to 4,096.
Llama Embed Nemotron 8B → KaLM Embedding Gemma3 12B 2511
Re-embed your whole corpus›
Vectors from different models can't be mixed; dimensions change from 4,096 to 3,840.