KaLM Embedding Gemma3 12B 2511 vs Qwen 3 Embedding 8B

KaLM Embedding Gemma3 12B 2511

Wins 14 of 133 benchmarks

Qwen 3 Embedding 8B

$0.01 / 1M tokens

Wins 18 of 133 benchmarks

Only shared

MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)?

KaLM Embedding Gemma3 12B 251172.3

Qwen 3 Embedding 8B70.6

FollowIR · Mean over tasks · English?

KaLM Embedding Gemma3 12B 25115.5

Qwen 3 Embedding 8B10.1

FollowIR · Mean over task types · English?

KaLM Embedding Gemma3 12B 25115.5

Qwen 3 Embedding 8B10.1

FollowIR · Instruction Reranking · English?

KaLM Embedding Gemma3 12B 25115.5

Qwen 3 Embedding 8B10.1

MTEB Europe v1 · Bitext Mining · multilingual (28 languages)?

KaLM Embedding Gemma3 12B 251192.8

Qwen 3 Embedding 8B93

MTEB Europe v1 · Clustering · multilingual (29 languages)?

KaLM Embedding Gemma3 12B 251150.7

Qwen 3 Embedding 8B50.4

MTEB Europe v1 · Instruction Reranking · English?

KaLM Embedding Gemma3 12B 25115.5

Qwen 3 Embedding 8B10.1

MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)?

KaLM Embedding Gemma3 12B 251125.2

Qwen 3 Embedding 8B23.7

MTEB Europe v1 · Reranking · multilingual (12 languages)?

KaLM Embedding Gemma3 12B 251163.1

Qwen 3 Embedding 8B62.6

MTEB French v1 · Pair Classification · French?

KaLM Embedding Gemma3 12B 251169.2

Qwen 3 Embedding 8B79.2

MTEB Indic v1 · Clustering · multilingual (21 languages)?

KaLM Embedding Gemma3 12B 251152.9

Qwen 3 Embedding 8B55.7

MTEB Indic v1 · Pair Classification · Hindi?

KaLM Embedding Gemma3 12B 251182.5

Qwen 3 Embedding 8B86.6

MTEB Indic v1 · Reranking · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 251187.6

Qwen 3 Embedding 8B86.8

MTEB Indic v1 · STS · multilingual (13 languages)?

KaLM Embedding Gemma3 12B 251163.4

Qwen 3 Embedding 8B61.6

MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)?

KaLM Embedding Gemma3 12B 251162.5

Qwen 3 Embedding 8B61.7

MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)?

KaLM Embedding Gemma3 12B 251183.8

Qwen 3 Embedding 8B80.9

MTEB multilingual v2 · Classification · multilingual (119 languages)?

KaLM Embedding Gemma3 12B 251177.9

Qwen 3 Embedding 8B74

MTEB multilingual v2 · Clustering · multilingual (208 languages)?

KaLM Embedding Gemma3 12B 251155.8

Qwen 3 Embedding 8B57.6

MTEB multilingual v2 · Instruction Reranking · English?

KaLM Embedding Gemma3 12B 25115.5

Qwen 3 Embedding 8B10.1

MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)?

KaLM Embedding Gemma3 12B 251133

Qwen 3 Embedding 8B28.7

MTEB multilingual v2 · Pair Classification · multilingual (24 languages)?

KaLM Embedding Gemma3 12B 251184.7

Qwen 3 Embedding 8B86.4

MTEB multilingual v2 · Reranking · multilingual (22 languages)?

KaLM Embedding Gemma3 12B 251167.3

Qwen 3 Embedding 8B65.6

MTEB multilingual v2 · Retrieval · multilingual (120 languages)?

KaLM Embedding Gemma3 12B 251175.7

Qwen 3 Embedding 8B70.9

MTEB multilingual v2 · STS · multilingual (35 languages)?

KaLM Embedding Gemma3 12B 251179

Qwen 3 Embedding 8B81.1

MTEB Dutch v1 · Reranking · Dutch?

KaLM Embedding Gemma3 12B 251190.5

Qwen 3 Embedding 8B91.2

MTEB Portuguese v1 · Multilabel Classification · Portuguese?

KaLM Embedding Gemma3 12B 251131.6

Qwen 3 Embedding 8B22

MTEB Russian v1.1 · Pair Classification · Russian?

KaLM Embedding Gemma3 12B 251161.6

Qwen 3 Embedding 8B71.3

MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)?

KaLM Embedding Gemma3 12B 251182.7

Qwen 3 Embedding 8B84.7

MTEB Spanish v1 · Pair Classification · Spanish?

KaLM Embedding Gemma3 12B 251177.7

Qwen 3 Embedding 8B84.4

MTEB Thai v1 · Classification · Thai?

KaLM Embedding Gemma3 12B 251176.2

Qwen 3 Embedding 8B67.7

MTEB Thai v1 · Clustering · Thai?

KaLM Embedding Gemma3 12B 251157.2

Qwen 3 Embedding 8B58.2

MTEB Thai v1 · Pair Classification · Thai?

KaLM Embedding Gemma3 12B 251185.1

Qwen 3 Embedding 8B88.6

BEIR · Mean over tasks · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B62.8

BEIR · Mean over task types · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B62.8

BEIR · Retrieval · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B62.8

ChemTEB · Bitext Mining · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B0.5

ChemTEB · Clustering · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B50.1

ChemTEB · Pair Classification · multilingual (13 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B63.6

ChemTEB · Retrieval · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B74.6

CoIR · Mean over tasks · multilingual (9 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B79.9

CoIR · Mean over task types · multilingual (9 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B79.9

CoIR · Retrieval · multilingual (9 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B79.9

CoREB v1 · Mean over tasks · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B59

CoREB v1 · Mean over task types · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B59

CoREB v1 · Reranking · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B54.1

CoREB v1 · Retrieval · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B63.8

JMTEB v2 · Clustering · Japanese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B56.1

JMTEB v2 · STS · Japanese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B87.8

MTEB Mandarin Chinese v1 · Mean over tasks · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B73.9

MTEB Mandarin Chinese v1 · Mean over task types · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B75

MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B77.1

MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B80.1

MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B84.2

MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B67

MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B78.2

MTEB Mandarin Chinese v1 · STS · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B63.5

MTEB Code v1 · Mean over tasks · multilingual (15 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B80.7

MTEB Code v1 · Mean over task types · multilingual (15 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B80.7

MTEB Code v1 · Retrieval · multilingual (15 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B80.7

MTEB German v1 · Pair Classification · German?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B64.7

MTEB German v1 · STS · German?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B79.6

MTEB Europe v1 · Mean over tasks · multilingual (29 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B69.9

MTEB Europe v1 · Mean over task types · multilingual (29 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B61.8

MTEB Europe v1 · Classification · multilingual (23 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B74.4

MTEB Europe v1 · Pair Classification · multilingual (11 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B93.7

MTEB Europe v1 · Retrieval · multilingual (25 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B66.5

MTEB Europe v1 · STS · multilingual (8 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B81.6

MTEB Persian v2 · Bitext Mining · Persian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B62.3

MTEB Persian v2 · Clustering · Persian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B68.5

MTEB Persian v2 · STS · Persian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B83.3

MTEB French v1 · Reranking · French?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B89

MTEB French v1 · Retrieval · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B71.8

MTEB French v1 · STS · French?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B86.8

MTEB French v1 · Summarization · French?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B30.4

MTEB Indic v1 · Classification · multilingual (8 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B73.3

MTEB Indic v1 · Retrieval · multilingual (14 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B94.7

MTEB Korean v2 · Mean over tasks · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B77.8

MTEB Korean v2 · Mean over task types · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B75.5

MTEB Korean v2 · Classification · Korean?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B69.1

MTEB Korean v2 · Clustering · Korean?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B70.9

MTEB Korean v2 · Pair Classification · Korean?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B77.3

MTEB Korean v2 · Reranking · Korean?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B67.4

MTEB Korean v2 · Retrieval · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B78.4

MTEB Korean v2 · STS · Korean?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B89.8

MTEB Medical v1 · Clustering · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B45.1

MTEB Medical v1 · Reranking · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B86.4

MTEB Dutch v1 · Mean over tasks · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B65.6

MTEB Dutch v1 · Mean over task types · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B70.1

MTEB Dutch v1 · Classification · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B73

MTEB Dutch v1 · Clustering · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B49

MTEB Dutch v1 · Multilabel Classification · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B41.5

MTEB Dutch v1 · Pair Classification · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B82.4

MTEB Dutch v1 · Retrieval · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B66.8

MTEB Dutch v1 · STS · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B87

MTEB Polish v1 · Mean over tasks · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B73.5

MTEB Polish v1 · Mean over task types · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B71.7

MTEB Polish v1 · Classification · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B75.6

MTEB Polish v1 · Clustering · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B50.5

MTEB Polish v1 · Pair Classification · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B87.7

MTEB Polish v1 · STS · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B72.8

MTEB Portuguese v1 · Classification · Portuguese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B70.8

MTEB Portuguese v1 · STS · Portuguese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B86

MTEB Russian v1.1 · Mean over tasks · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B71.4

MTEB Russian v1.1 · Mean over task types · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B69.2

MTEB Russian v1.1 · Classification · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B74.3

MTEB Russian v1.1 · Clustering · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B66.7

MTEB Russian v1.1 · Multilabel Classification · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B44.6

MTEB Russian v1.1 · Reranking · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B70.2

MTEB Russian v1.1 · Retrieval · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B78.2

MTEB Russian v1.1 · STS · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B79.3

MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B70.4

MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B71.5

MTEB Scandinavian v1 · Classification · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B74.8

MTEB Scandinavian v1 · Clustering · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B55.2

MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B71.2

MTEB Spanish v1 · Classification · Spanish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B92.6

MTEB Spanish v1 · STS · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B82.5

MTEB Thai v1 · Mean over tasks · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 251166.4

Qwen 3 Embedding 8B—

MTEB Thai v1 · Mean over task types · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 251166.8

Qwen 3 Embedding 8B—

MTEB Thai v1 · Reranking · Thai?

KaLM Embedding Gemma3 12B 251151.7

Qwen 3 Embedding 8B—

MTEB Thai v1 · Retrieval · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 251163.7

Qwen 3 Embedding 8B—

RTEB German beta · Mean over tasks · German?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B66.8

RTEB Finnish beta · Mean over tasks · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B72.7

RTEB French beta · Mean over tasks · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B59.5

RTEB Health beta · Mean over tasks · multilingual (4 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B67

RTEB Law beta · Mean over tasks · multilingual (4 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B67.2

MTEB English v2 · Summarization · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B34.8

MTEB English v2 · Clustering · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B58.6

MTEB English v2 · Classification · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B90.4

MTEB English v2 · Reranking · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B51.6

MTEB English v2 · STS · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B88.6

MTEB English v2 · Pair Classification · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B87.5

MTEB English v2 · Retrieval · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 8B69.4

Benchmark	KaLM Embedding Gemma3 12B 2511	Qwen 3 Embedding 8B
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)	72.3	70.6
FollowIR · Mean over tasks · English	5.5	10.1
FollowIR · Mean over task types · English	5.5	10.1
FollowIR · Instruction Reranking · English	5.5	10.1
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)	92.8	93
MTEB Europe v1 · Clustering · multilingual (29 languages)	50.7	50.4
MTEB Europe v1 · Instruction Reranking · English	5.5	10.1
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)	25.2	23.7
MTEB Europe v1 · Reranking · multilingual (12 languages)	63.1	62.6
MTEB French v1 · Pair Classification · French	69.2	79.2
MTEB Indic v1 · Clustering · multilingual (21 languages)	52.9	55.7
MTEB Indic v1 · Pair Classification · Hindi	82.5	86.6
MTEB Indic v1 · Reranking · multilingual (2 languages)	87.6	86.8
MTEB Indic v1 · STS · multilingual (13 languages)	63.4	61.6
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)	62.5	61.7
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)	83.8	80.9
MTEB multilingual v2 · Classification · multilingual (119 languages)	77.9	74
MTEB multilingual v2 · Clustering · multilingual (208 languages)	55.8	57.6
MTEB multilingual v2 · Instruction Reranking · English	5.5	10.1
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)	33	28.7
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)	84.7	86.4
MTEB multilingual v2 · Reranking · multilingual (22 languages)	67.3	65.6
MTEB multilingual v2 · Retrieval · multilingual (120 languages)	75.7	70.9
MTEB multilingual v2 · STS · multilingual (35 languages)	79	81.1
MTEB Dutch v1 · Reranking · Dutch	90.5	91.2
MTEB Portuguese v1 · Multilabel Classification · Portuguese	31.6	22
MTEB Russian v1.1 · Pair Classification · Russian	61.6	71.3
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)	82.7	84.7
MTEB Spanish v1 · Pair Classification · Spanish	77.7	84.4
MTEB Thai v1 · Classification · Thai	76.2	67.7
MTEB Thai v1 · Clustering · Thai	57.2	58.2
MTEB Thai v1 · Pair Classification · Thai	85.1	88.6
BEIR · Mean over tasks · English	—	62.8
BEIR · Mean over task types · English	—	62.8
BEIR · Retrieval · English	—	62.8
ChemTEB · Bitext Mining · English	—	0.5
ChemTEB · Clustering · English	—	50.1
ChemTEB · Pair Classification · multilingual (13 languages)	—	63.6
ChemTEB · Retrieval · English	—	74.6
CoIR · Mean over tasks · multilingual (9 languages)	—	79.9
CoIR · Mean over task types · multilingual (9 languages)	—	79.9
CoIR · Retrieval · multilingual (9 languages)	—	79.9
CoREB v1 · Mean over tasks · multilingual (6 languages)	—	59
CoREB v1 · Mean over task types · multilingual (6 languages)	—	59
CoREB v1 · Reranking · multilingual (6 languages)	—	54.1
CoREB v1 · Retrieval · multilingual (6 languages)	—	63.8
JMTEB v2 · Clustering · Japanese	—	56.1
JMTEB v2 · STS · Japanese	—	87.8
MTEB Mandarin Chinese v1 · Mean over tasks · Mandarin Chinese	—	73.9
MTEB Mandarin Chinese v1 · Mean over task types · Mandarin Chinese	—	75
MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese	—	77.1
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese	—	80.1
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese	—	84.2
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese	—	67
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese	—	78.2
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese	—	63.5
MTEB Code v1 · Mean over tasks · multilingual (15 languages)	—	80.7
MTEB Code v1 · Mean over task types · multilingual (15 languages)	—	80.7
MTEB Code v1 · Retrieval · multilingual (15 languages)	—	80.7
MTEB German v1 · Pair Classification · German	—	64.7
MTEB German v1 · STS · German	—	79.6
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)	—	69.9
MTEB Europe v1 · Mean over task types · multilingual (29 languages)	—	61.8
MTEB Europe v1 · Classification · multilingual (23 languages)	—	74.4
MTEB Europe v1 · Pair Classification · multilingual (11 languages)	—	93.7
MTEB Europe v1 · Retrieval · multilingual (25 languages)	—	66.5
MTEB Europe v1 · STS · multilingual (8 languages)	—	81.6
MTEB Persian v2 · Bitext Mining · Persian	—	62.3
MTEB Persian v2 · Clustering · Persian	—	68.5
MTEB Persian v2 · STS · Persian	—	83.3
MTEB French v1 · Reranking · French	—	89
MTEB French v1 · Retrieval · multilingual (2 languages)	—	71.8
MTEB French v1 · STS · French	—	86.8
MTEB French v1 · Summarization · French	—	30.4
MTEB Indic v1 · Classification · multilingual (8 languages)	—	73.3
MTEB Indic v1 · Retrieval · multilingual (14 languages)	—	94.7
MTEB Korean v2 · Mean over tasks · multilingual (2 languages)	—	77.8
MTEB Korean v2 · Mean over task types · multilingual (2 languages)	—	75.5
MTEB Korean v2 · Classification · Korean	—	69.1
MTEB Korean v2 · Clustering · Korean	—	70.9
MTEB Korean v2 · Pair Classification · Korean	—	77.3
MTEB Korean v2 · Reranking · Korean	—	67.4
MTEB Korean v2 · Retrieval · multilingual (2 languages)	—	78.4
MTEB Korean v2 · STS · Korean	—	89.8
MTEB Medical v1 · Clustering · English	—	45.1
MTEB Medical v1 · Reranking · Mandarin Chinese	—	86.4
MTEB Dutch v1 · Mean over tasks · Dutch	—	65.6
MTEB Dutch v1 · Mean over task types · Dutch	—	70.1
MTEB Dutch v1 · Classification · Dutch	—	73
MTEB Dutch v1 · Clustering · Dutch	—	49
MTEB Dutch v1 · Multilabel Classification · Dutch	—	41.5
MTEB Dutch v1 · Pair Classification · Dutch	—	82.4
MTEB Dutch v1 · Retrieval · Dutch	—	66.8
MTEB Dutch v1 · STS · Dutch	—	87
MTEB Polish v1 · Mean over tasks · Polish	—	73.5
MTEB Polish v1 · Mean over task types · Polish	—	71.7
MTEB Polish v1 · Classification · Polish	—	75.6
MTEB Polish v1 · Clustering · Polish	—	50.5
MTEB Polish v1 · Pair Classification · Polish	—	87.7
MTEB Polish v1 · STS · Polish	—	72.8
MTEB Portuguese v1 · Classification · Portuguese	—	70.8
MTEB Portuguese v1 · STS · Portuguese	—	86
MTEB Russian v1.1 · Mean over tasks · Russian	—	71.4
MTEB Russian v1.1 · Mean over task types · Russian	—	69.2
MTEB Russian v1.1 · Classification · Russian	—	74.3
MTEB Russian v1.1 · Clustering · Russian	—	66.7
MTEB Russian v1.1 · Multilabel Classification · Russian	—	44.6
MTEB Russian v1.1 · Reranking · Russian	—	70.2
MTEB Russian v1.1 · Retrieval · Russian	—	78.2
MTEB Russian v1.1 · STS · Russian	—	79.3
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)	—	70.4
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)	—	71.5
MTEB Scandinavian v1 · Classification · multilingual (6 languages)	—	74.8
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)	—	55.2
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)	—	71.2
MTEB Spanish v1 · Classification · Spanish	—	92.6
MTEB Spanish v1 · STS · multilingual (2 languages)	—	82.5
MTEB Thai v1 · Mean over tasks · multilingual (2 languages)	66.4	—
MTEB Thai v1 · Mean over task types · multilingual (2 languages)	66.8	—
MTEB Thai v1 · Reranking · Thai	51.7	—
MTEB Thai v1 · Retrieval · multilingual (2 languages)	63.7	—
RTEB German beta · Mean over tasks · German	—	66.8
RTEB Finnish beta · Mean over tasks · English	—	72.7
RTEB French beta · Mean over tasks · multilingual (2 languages)	—	59.5
RTEB Health beta · Mean over tasks · multilingual (4 languages)	—	67
RTEB Law beta · Mean over tasks · multilingual (4 languages)	—	67.2
MTEB English v2 · Summarization · English	—	34.8
MTEB English v2 · Clustering · English	—	58.6
MTEB English v2 · Classification · English	—	90.4
MTEB English v2 · Reranking · English	—	51.6
MTEB English v2 · STS · English	—	88.6
MTEB English v2 · Pair Classification · English	—	87.5
MTEB English v2 · Retrieval · English	—	69.4

Specs

Spec	KaLM Embedding Gemma3 12B 2511	Qwen 3 Embedding 8B
Price	—	!$0.01
Context	33K	33K
Weights	Open	Open
Released	Nov 2025	Jun 2025
Published speed	—	3.3 × vLLM H100 (Baseten)
Dimensions	3,840	4,096
Max input	131K tokens	33K tokens
Memory (4-bit)	7.1 GB	4.5 GB
Licence	tencent-kalm-embedding-community	Apache-2.0
Commercial use	Restricted	Allowed

What breaks when you switch

KaLM Embedding Gemma3 12B 2511 → Qwen 3 Embedding 8B

Re-embed your whole corpus›

Vectors from different models can't be mixed; dimensions change from 3,840 to 4,096.

Max input: 131K tokens → 33K tokens

Qwen 3 Embedding 8B → KaLM Embedding Gemma3 12B 2511

Re-embed your whole corpus›

Vectors from different models can't be mixed; dimensions change from 4,096 to 3,840.

Memory (4-bit): 4.5 GB → 7.1 GB