KaLM Embedding Gemma3 12B 2511 vs Qwen 3 Embedding 4B

KaLM Embedding Gemma3 12B 2511

Wins 19 of 130 benchmarks

Qwen 3 Embedding 4B

$0.02 / 1M tokens

Wins 14 of 130 benchmarks

Only shared

MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)?

KaLM Embedding Gemma3 12B 251172.3

Qwen 3 Embedding 4B69.4

FollowIR · Mean over tasks · English?

KaLM Embedding Gemma3 12B 25115.5

Qwen 3 Embedding 4B11.6

FollowIR · Mean over task types · English?

KaLM Embedding Gemma3 12B 25115.5

Qwen 3 Embedding 4B11.6

FollowIR · Instruction Reranking · English?

KaLM Embedding Gemma3 12B 25115.5

Qwen 3 Embedding 4B11.6

MTEB Europe v1 · Bitext Mining · multilingual (28 languages)?

KaLM Embedding Gemma3 12B 251192.8

Qwen 3 Embedding 4B92.2

MTEB Europe v1 · Clustering · multilingual (29 languages)?

KaLM Embedding Gemma3 12B 251150.7

Qwen 3 Embedding 4B50.4

MTEB Europe v1 · Instruction Reranking · English?

KaLM Embedding Gemma3 12B 25115.5

Qwen 3 Embedding 4B11.6

MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)?

KaLM Embedding Gemma3 12B 251125.2

Qwen 3 Embedding 4B23.6

MTEB Europe v1 · Reranking · multilingual (12 languages)?

KaLM Embedding Gemma3 12B 251163.1

Qwen 3 Embedding 4B62

MTEB French v1 · Pair Classification · French?

KaLM Embedding Gemma3 12B 251169.2

Qwen 3 Embedding 4B72.6

MTEB Indic v1 · Clustering · multilingual (21 languages)?

KaLM Embedding Gemma3 12B 251152.9

Qwen 3 Embedding 4B49.7

MTEB Indic v1 · Pair Classification · Hindi?

KaLM Embedding Gemma3 12B 251182.5

Qwen 3 Embedding 4B85.6

MTEB Indic v1 · Reranking · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 251187.6

Qwen 3 Embedding 4B85.8

MTEB Indic v1 · STS · multilingual (13 languages)?

KaLM Embedding Gemma3 12B 251163.4

Qwen 3 Embedding 4B60.8

MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)?

KaLM Embedding Gemma3 12B 251162.5

Qwen 3 Embedding 4B60.9

MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)?

KaLM Embedding Gemma3 12B 251183.8

Qwen 3 Embedding 4B79.4

MTEB multilingual v2 · Classification · multilingual (119 languages)?

KaLM Embedding Gemma3 12B 251177.9

Qwen 3 Embedding 4B72.3

MTEB multilingual v2 · Clustering · multilingual (208 languages)?

KaLM Embedding Gemma3 12B 251155.8

Qwen 3 Embedding 4B57.1

MTEB multilingual v2 · Instruction Reranking · English?

KaLM Embedding Gemma3 12B 25115.5

Qwen 3 Embedding 4B11.6

MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)?

KaLM Embedding Gemma3 12B 251133

Qwen 3 Embedding 4B26.8

MTEB multilingual v2 · Pair Classification · multilingual (24 languages)?

KaLM Embedding Gemma3 12B 251184.7

Qwen 3 Embedding 4B85.1

MTEB multilingual v2 · Reranking · multilingual (22 languages)?

KaLM Embedding Gemma3 12B 251167.3

Qwen 3 Embedding 4B65.1

MTEB multilingual v2 · Retrieval · multilingual (120 languages)?

KaLM Embedding Gemma3 12B 251175.7

Qwen 3 Embedding 4B69.6

MTEB multilingual v2 · STS · multilingual (35 languages)?

KaLM Embedding Gemma3 12B 251179

Qwen 3 Embedding 4B80.9

MTEB Dutch v1 · Reranking · Dutch?

KaLM Embedding Gemma3 12B 251190.5

Qwen 3 Embedding 4B89.1

MTEB Portuguese v1 · Multilabel Classification · Portuguese?

KaLM Embedding Gemma3 12B 251131.6

Qwen 3 Embedding 4B20.6

MTEB Russian v1.1 · Pair Classification · Russian?

KaLM Embedding Gemma3 12B 251161.6

Qwen 3 Embedding 4B66.6

MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)?

KaLM Embedding Gemma3 12B 251182.7

Qwen 3 Embedding 4B82.2

MTEB Spanish v1 · Pair Classification · Spanish?

KaLM Embedding Gemma3 12B 251177.7

Qwen 3 Embedding 4B80.1

MTEB Thai v1 · Classification · Thai?

KaLM Embedding Gemma3 12B 251176.2

Qwen 3 Embedding 4B72.4

MTEB Thai v1 · Clustering · Thai?

KaLM Embedding Gemma3 12B 251157.2

Qwen 3 Embedding 4B54.3

MTEB Thai v1 · Pair Classification · Thai?

KaLM Embedding Gemma3 12B 251185.1

Qwen 3 Embedding 4B86.7

MTEB Thai v1 · Reranking · Thai?

KaLM Embedding Gemma3 12B 251151.7

Qwen 3 Embedding 4B61.7

BEIR · Mean over tasks · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B61.6

BEIR · Mean over task types · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B61.6

BEIR · Retrieval · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B61.6

ChemTEB · Bitext Mining · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B0.3

ChemTEB · Clustering · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B41.2

ChemTEB · Pair Classification · multilingual (13 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B64.8

ChemTEB · Retrieval · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B74

CoIR · Mean over tasks · multilingual (9 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B79.2

CoIR · Mean over task types · multilingual (9 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B79.2

CoIR · Retrieval · multilingual (9 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B79.2

CoREB v1 · Mean over tasks · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B56.5

CoREB v1 · Mean over task types · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B56.5

CoREB v1 · Reranking · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B52.3

CoREB v1 · Retrieval · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B60.6

JMTEB v2 · Clustering · Japanese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B53.4

JMTEB v2 · STS · Japanese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B87.3

MTEB Mandarin Chinese v1 · Mean over tasks · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B72.3

MTEB Mandarin Chinese v1 · Mean over task types · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B73.5

MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B75.5

MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B77.9

MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B83.3

MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B66.1

MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B77

MTEB Mandarin Chinese v1 · STS · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B61.3

MTEB Code v1 · Mean over tasks · multilingual (15 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B80.1

MTEB Code v1 · Mean over task types · multilingual (15 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B80.1

MTEB Code v1 · Retrieval · multilingual (15 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B80.1

MTEB German v1 · Pair Classification · German?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B61.8

MTEB German v1 · STS · German?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B79

MTEB Europe v1 · Mean over tasks · multilingual (29 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B69

MTEB Europe v1 · Mean over task types · multilingual (29 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B61.3

MTEB Europe v1 · Classification · multilingual (23 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B72.3

MTEB Europe v1 · Pair Classification · multilingual (11 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B93

MTEB Europe v1 · Retrieval · multilingual (25 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B65.6

MTEB Europe v1 · STS · multilingual (8 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B81.2

MTEB Persian v2 · Bitext Mining · Persian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B61.3

MTEB Persian v2 · Clustering · Persian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B68.1

MTEB Persian v2 · STS · Persian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B81.7

MTEB French v1 · Reranking · French?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B88.6

MTEB French v1 · Retrieval · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B68.5

MTEB French v1 · STS · French?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B86.2

MTEB French v1 · Summarization · French?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B31.3

MTEB Indic v1 · Classification · multilingual (8 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B70.7

MTEB Indic v1 · Retrieval · multilingual (14 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B90.3

MTEB Korean v2 · Mean over tasks · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B76.8

MTEB Korean v2 · Mean over task types · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B74.6

MTEB Korean v2 · Classification · Korean?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B67.4

MTEB Korean v2 · Clustering · Korean?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B70.9

MTEB Korean v2 · Pair Classification · Korean?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B75.3

MTEB Korean v2 · Reranking · Korean?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B67.3

MTEB Korean v2 · Retrieval · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B77.1

MTEB Korean v2 · STS · Korean?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B89.9

MTEB Medical v1 · Clustering · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B44.6

MTEB Medical v1 · Reranking · Mandarin Chinese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B85.1

MTEB Dutch v1 · Mean over tasks · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B63.7

MTEB Dutch v1 · Mean over task types · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B68.5

MTEB Dutch v1 · Classification · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B70.7

MTEB Dutch v1 · Clustering · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B46.5

MTEB Dutch v1 · Multilabel Classification · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B40.2

MTEB Dutch v1 · Pair Classification · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B81.5

MTEB Dutch v1 · Retrieval · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B65.1

MTEB Dutch v1 · STS · Dutch?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B86.1

MTEB Polish v1 · Mean over tasks · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B72.3

MTEB Polish v1 · Mean over task types · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B70.5

MTEB Polish v1 · Classification · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B74.1

MTEB Polish v1 · Clustering · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B49

MTEB Polish v1 · Pair Classification · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B86.9

MTEB Polish v1 · STS · Polish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B72.1

MTEB Portuguese v1 · Classification · Portuguese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B67.7

MTEB Portuguese v1 · STS · Portuguese?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B85.6

MTEB Russian v1.1 · Mean over tasks · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B70.1

MTEB Russian v1.1 · Mean over task types · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B67.5

MTEB Russian v1.1 · Classification · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B73.6

MTEB Russian v1.1 · Clustering · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B65.1

MTEB Russian v1.1 · Multilabel Classification · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B43.3

MTEB Russian v1.1 · Reranking · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B68.7

MTEB Russian v1.1 · Retrieval · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B76.4

MTEB Russian v1.1 · STS · Russian?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B78.5

MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B68.6

MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B69.6

MTEB Scandinavian v1 · Classification · multilingual (6 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B72.9

MTEB Scandinavian v1 · Clustering · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B54.9

MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B68.4

MTEB Spanish v1 · Classification · Spanish?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B87.2

MTEB Spanish v1 · STS · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B82.7

MTEB Thai v1 · Mean over tasks · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 251166.4

Qwen 3 Embedding 4B—

MTEB Thai v1 · Mean over task types · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 251166.8

Qwen 3 Embedding 4B—

MTEB Thai v1 · Retrieval · multilingual (2 languages)?

KaLM Embedding Gemma3 12B 251163.7

Qwen 3 Embedding 4B—

RTEB German beta · Mean over tasks · German?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B66.6

RTEB Law beta · Mean over tasks · multilingual (4 languages)?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B63.5

MTEB English v2 · Summarization · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B34.4

MTEB English v2 · Clustering · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B57.5

MTEB English v2 · Classification · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B89.8

MTEB English v2 · Reranking · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B50.8

MTEB English v2 · STS · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B88.7

MTEB English v2 · Pair Classification · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B87

MTEB English v2 · Retrieval · English?

KaLM Embedding Gemma3 12B 2511—

Qwen 3 Embedding 4B68.5

Benchmark	KaLM Embedding Gemma3 12B 2511	Qwen 3 Embedding 4B
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)	72.3	69.4
FollowIR · Mean over tasks · English	5.5	11.6
FollowIR · Mean over task types · English	5.5	11.6
FollowIR · Instruction Reranking · English	5.5	11.6
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)	92.8	92.2
MTEB Europe v1 · Clustering · multilingual (29 languages)	50.7	50.4
MTEB Europe v1 · Instruction Reranking · English	5.5	11.6
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)	25.2	23.6
MTEB Europe v1 · Reranking · multilingual (12 languages)	63.1	62
MTEB French v1 · Pair Classification · French	69.2	72.6
MTEB Indic v1 · Clustering · multilingual (21 languages)	52.9	49.7
MTEB Indic v1 · Pair Classification · Hindi	82.5	85.6
MTEB Indic v1 · Reranking · multilingual (2 languages)	87.6	85.8
MTEB Indic v1 · STS · multilingual (13 languages)	63.4	60.8
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)	62.5	60.9
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)	83.8	79.4
MTEB multilingual v2 · Classification · multilingual (119 languages)	77.9	72.3
MTEB multilingual v2 · Clustering · multilingual (208 languages)	55.8	57.1
MTEB multilingual v2 · Instruction Reranking · English	5.5	11.6
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)	33	26.8
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)	84.7	85.1
MTEB multilingual v2 · Reranking · multilingual (22 languages)	67.3	65.1
MTEB multilingual v2 · Retrieval · multilingual (120 languages)	75.7	69.6
MTEB multilingual v2 · STS · multilingual (35 languages)	79	80.9
MTEB Dutch v1 · Reranking · Dutch	90.5	89.1
MTEB Portuguese v1 · Multilabel Classification · Portuguese	31.6	20.6
MTEB Russian v1.1 · Pair Classification · Russian	61.6	66.6
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)	82.7	82.2
MTEB Spanish v1 · Pair Classification · Spanish	77.7	80.1
MTEB Thai v1 · Classification · Thai	76.2	72.4
MTEB Thai v1 · Clustering · Thai	57.2	54.3
MTEB Thai v1 · Pair Classification · Thai	85.1	86.7
MTEB Thai v1 · Reranking · Thai	51.7	61.7
BEIR · Mean over tasks · English	—	61.6
BEIR · Mean over task types · English	—	61.6
BEIR · Retrieval · English	—	61.6
ChemTEB · Bitext Mining · English	—	0.3
ChemTEB · Clustering · English	—	41.2
ChemTEB · Pair Classification · multilingual (13 languages)	—	64.8
ChemTEB · Retrieval · English	—	74
CoIR · Mean over tasks · multilingual (9 languages)	—	79.2
CoIR · Mean over task types · multilingual (9 languages)	—	79.2
CoIR · Retrieval · multilingual (9 languages)	—	79.2
CoREB v1 · Mean over tasks · multilingual (6 languages)	—	56.5
CoREB v1 · Mean over task types · multilingual (6 languages)	—	56.5
CoREB v1 · Reranking · multilingual (6 languages)	—	52.3
CoREB v1 · Retrieval · multilingual (6 languages)	—	60.6
JMTEB v2 · Clustering · Japanese	—	53.4
JMTEB v2 · STS · Japanese	—	87.3
MTEB Mandarin Chinese v1 · Mean over tasks · Mandarin Chinese	—	72.3
MTEB Mandarin Chinese v1 · Mean over task types · Mandarin Chinese	—	73.5
MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese	—	75.5
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese	—	77.9
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese	—	83.3
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese	—	66.1
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese	—	77
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese	—	61.3
MTEB Code v1 · Mean over tasks · multilingual (15 languages)	—	80.1
MTEB Code v1 · Mean over task types · multilingual (15 languages)	—	80.1
MTEB Code v1 · Retrieval · multilingual (15 languages)	—	80.1
MTEB German v1 · Pair Classification · German	—	61.8
MTEB German v1 · STS · German	—	79
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)	—	69
MTEB Europe v1 · Mean over task types · multilingual (29 languages)	—	61.3
MTEB Europe v1 · Classification · multilingual (23 languages)	—	72.3
MTEB Europe v1 · Pair Classification · multilingual (11 languages)	—	93
MTEB Europe v1 · Retrieval · multilingual (25 languages)	—	65.6
MTEB Europe v1 · STS · multilingual (8 languages)	—	81.2
MTEB Persian v2 · Bitext Mining · Persian	—	61.3
MTEB Persian v2 · Clustering · Persian	—	68.1
MTEB Persian v2 · STS · Persian	—	81.7
MTEB French v1 · Reranking · French	—	88.6
MTEB French v1 · Retrieval · multilingual (2 languages)	—	68.5
MTEB French v1 · STS · French	—	86.2
MTEB French v1 · Summarization · French	—	31.3
MTEB Indic v1 · Classification · multilingual (8 languages)	—	70.7
MTEB Indic v1 · Retrieval · multilingual (14 languages)	—	90.3
MTEB Korean v2 · Mean over tasks · multilingual (2 languages)	—	76.8
MTEB Korean v2 · Mean over task types · multilingual (2 languages)	—	74.6
MTEB Korean v2 · Classification · Korean	—	67.4
MTEB Korean v2 · Clustering · Korean	—	70.9
MTEB Korean v2 · Pair Classification · Korean	—	75.3
MTEB Korean v2 · Reranking · Korean	—	67.3
MTEB Korean v2 · Retrieval · multilingual (2 languages)	—	77.1
MTEB Korean v2 · STS · Korean	—	89.9
MTEB Medical v1 · Clustering · English	—	44.6
MTEB Medical v1 · Reranking · Mandarin Chinese	—	85.1
MTEB Dutch v1 · Mean over tasks · Dutch	—	63.7
MTEB Dutch v1 · Mean over task types · Dutch	—	68.5
MTEB Dutch v1 · Classification · Dutch	—	70.7
MTEB Dutch v1 · Clustering · Dutch	—	46.5
MTEB Dutch v1 · Multilabel Classification · Dutch	—	40.2
MTEB Dutch v1 · Pair Classification · Dutch	—	81.5
MTEB Dutch v1 · Retrieval · Dutch	—	65.1
MTEB Dutch v1 · STS · Dutch	—	86.1
MTEB Polish v1 · Mean over tasks · Polish	—	72.3
MTEB Polish v1 · Mean over task types · Polish	—	70.5
MTEB Polish v1 · Classification · Polish	—	74.1
MTEB Polish v1 · Clustering · Polish	—	49
MTEB Polish v1 · Pair Classification · Polish	—	86.9
MTEB Polish v1 · STS · Polish	—	72.1
MTEB Portuguese v1 · Classification · Portuguese	—	67.7
MTEB Portuguese v1 · STS · Portuguese	—	85.6
MTEB Russian v1.1 · Mean over tasks · Russian	—	70.1
MTEB Russian v1.1 · Mean over task types · Russian	—	67.5
MTEB Russian v1.1 · Classification · Russian	—	73.6
MTEB Russian v1.1 · Clustering · Russian	—	65.1
MTEB Russian v1.1 · Multilabel Classification · Russian	—	43.3
MTEB Russian v1.1 · Reranking · Russian	—	68.7
MTEB Russian v1.1 · Retrieval · Russian	—	76.4
MTEB Russian v1.1 · STS · Russian	—	78.5
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)	—	68.6
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)	—	69.6
MTEB Scandinavian v1 · Classification · multilingual (6 languages)	—	72.9
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)	—	54.9
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)	—	68.4
MTEB Spanish v1 · Classification · Spanish	—	87.2
MTEB Spanish v1 · STS · multilingual (2 languages)	—	82.7
MTEB Thai v1 · Mean over tasks · multilingual (2 languages)	66.4	—
MTEB Thai v1 · Mean over task types · multilingual (2 languages)	66.8	—
MTEB Thai v1 · Retrieval · multilingual (2 languages)	63.7	—
RTEB German beta · Mean over tasks · German	—	66.6
RTEB Law beta · Mean over tasks · multilingual (4 languages)	—	63.5
MTEB English v2 · Summarization · English	—	34.4
MTEB English v2 · Clustering · English	—	57.5
MTEB English v2 · Classification · English	—	89.8
MTEB English v2 · Reranking · English	—	50.8
MTEB English v2 · STS · English	—	88.7
MTEB English v2 · Pair Classification · English	—	87
MTEB English v2 · Retrieval · English	—	68.5

Specs

Spec	KaLM Embedding Gemma3 12B 2511	Qwen 3 Embedding 4B
Price	—	!$0.02
Context	33K	33K
Weights	Open	Open
Released	Nov 2025	Jun 2025
Dimensions	3,840	2,560
Max input	131K tokens	33K tokens
Memory (4-bit)	7.1 GB	2.4 GB
Licence	tencent-kalm-embedding-community	Apache-2.0
Commercial use	Restricted	Allowed

What breaks when you switch

KaLM Embedding Gemma3 12B 2511 → Qwen 3 Embedding 4B

Re-embed your whole corpus›

Vectors from different models can't be mixed; dimensions change from 3,840 to 2,560.

Max input: 131K tokens → 33K tokens

Qwen 3 Embedding 4B → KaLM Embedding Gemma3 12B 2511

Re-embed your whole corpus›

Vectors from different models can't be mixed; dimensions change from 2,560 to 3,840.

Memory (4-bit): 2.4 GB → 7.1 GB