H

KaLM Embedding Multilingual Mini Instruct v1

Oct 2024
HKaLM Embedding Multilingual Mini Instruct v1
Compare in
on
self-host onlyprice
44.4MTEB English v2
Oct 2024released
896Dimensions
33K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1Cohere Embed Multilingual v3.055.62Nemotron 3 Embed 1B BF1655.43Jina Embeddings v5 Text Nano55.14Jina Embeddings v5 Text Small54.95Most Embed De54.7
···
52Arabic All Nli Triplet Matryoshka40.153KaLM Embedding Multilingual Mini Instruct v137.654Jina Embeddings v337.5

Strong at

C
Embeddings & Retrieval#131 of 200

Alternatives?

ModelScoreCostPriceWhat changes
iBetterMultilingual E5 LargeunstatedOpen+42%—$0.01Max input: 33K tokens → 1K tokensOpenNemotron 3 Embed 1B BF16+47%—$0.015Memory (4-bit): 0.3 GB → 0.7 GBiBetterMultilingual E5 Large InstructunstatedOpen+24%—$0.01Max input: 33K tokens → 1K tokensBetterJina Embeddings v5 Text NanounstatedOpen+46%—$0.02Max input: 33K tokens → 8K tokensiBetterE5 Mistral 7B InstructunstatedOpen+40%—$0.022Memory (4-bit): 0.3 GB → 4.3 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English51.9#81
BEIR · Mean over task types · English51.9#81
BEIR · Retrieval · English51.9#81
BEIR-NL · Mean over tasks · Dutch26.1#11
BEIR-NL · Mean over task types · Dutch26.1#11
BEIR-NL · Retrieval · Dutch26.1#11
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese47.9#55
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese50.9#49
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese64.4#46
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese70.5#45
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese73.1#39
MTEB Persian v2 · Reranking · Persian55.3#56
JMTEB v2 · Clustering · Japanese45.8#58
JMTEB v2 · STS · Japanese79.2#56
LongEmbed · Mean over tasks · English65.1#29
LongEmbed · Mean over task types · English65.1#29
LongEmbed · Retrieval · English65.1#29
MTEB German v1 · Classification · German66.8#38
MTEB German v1 · Pair Classification · German53.3#46
MTEB German v1 · Clustering · German34.6#28
MTEB German v1 · Retrieval · German43.7#40
MTEB German v1 · Reranking · German37.6#53
MTEB Europe v1 · Classification · multilingual (23 languages)59#29
MTEB Europe v1 · Instruction Reranking · English-2.6#151
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)18.4#38
MTEB Europe v1 · Pair Classification · multilingual (11 languages)87.4#48
MTEB Europe v1 · Clustering · multilingual (29 languages)40.9#58
MTEB Europe v1 · Retrieval · multilingual (25 languages)50.5#52
MTEB Europe v1 · Reranking · multilingual (12 languages)57.3#58
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)82.4#70
MTEB French v1 · Retrieval · multilingual (2 languages)53.8#31
MTEB French v1 · Classification · French67.7#31
MTEB French v1 · Reranking · French80.8#28
MTEB French v1 · Pair Classification · French61#59
MTEB French v1 · Summarization · French30.9#41
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)57.2#45
MTEB Indic v1 · Mean over task types · multilingual (25 languages)51.5#46
MTEB Indic v1 · Classification · multilingual (8 languages)61.3#41
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)49.6#47
MTEB Indic v1 · STS · multilingual (13 languages)23.1#76
MTEB Indic v1 · Reranking · multilingual (2 languages)76.8#85
MTEB Indic v1 · Retrieval · multilingual (14 languages)60#59
MTEB Indic v1 · Pair Classification · Hindi67.8#69
MTEB Indic v1 · Clustering · multilingual (21 languages)22.3#87
MTEB Korean v2 · Classification · Korean55.4#44
MTEB Korean v2 · Reranking · Korean27.7#65
MTEB Dutch v1 · Mean over tasks · Dutch53.6#42
MTEB Dutch v1 · Mean over task types · Dutch60.5#35
MTEB Dutch v1 · Retrieval · Dutch52.1#57
MTEB Dutch v1 · Classification · Dutch60.5#37
MTEB Dutch v1 · Multilabel Classification · Dutch36.3#29
MTEB Dutch v1 · STS · Dutch74.7#53
MTEB Dutch v1 · Clustering · Dutch37#31
MTEB Dutch v1 · Reranking · Dutch86.5#75
MTEB Dutch v1 · Pair Classification · Dutch76.4#43
MTEB Polish v1 · Mean over tasks · Polish64.6#20
MTEB Polish v1 · Mean over task types · Polish63.7#20
MTEB Polish v1 · Classification · Polish63.2#29
MTEB Polish v1 · Clustering · Polish43.7#21
MTEB Polish v1 · STS · Polish67.3#30
MTEB Polish v1 · Pair Classification · Polish80.6#55
MTEB Portuguese v1 · Multilabel Classification · Portuguese20.4#70
MTEB Law v1 · Mean over tasks · multilingual (3 languages)54.5#42
MTEB Law v1 · Mean over task types · multilingual (3 languages)54.5#42
MTEB Law v1 · Retrieval · multilingual (3 languages)54.5#42
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)57.3#28
MTEB Medical v1 · Mean over task types · multilingual (10 languages)58.8#25
MTEB Medical v1 · Retrieval · multilingual (10 languages)59.7#31
MTEB Medical v1 · Clustering · English34.2#141
MTEB Medical v1 · Reranking · Mandarin Chinese82.6#47
FollowIR · Mean over tasks · English-2.6#151
FollowIR · Mean over task types · English-2.6#151
FollowIR · Instruction Reranking · English-2.6#151
MTEB Spanish v1 · Pair Classification · Spanish68.9#43
MTEB Spanish v1 · Reranking · Spanish48.8#54
MTEB Spanish v1 · Classification · Spanish89#21
MTEB Thai v1 · Pair Classification · Thai67.6#72
MTEB Thai v1 · Clustering · Thai38.3#83
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)51.5#48
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)52.8#47
MTEB Scandinavian v1 · Classification · multilingual (6 languages)56.1#63
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)48.8#54
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)39.9#57
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)66.2#82
MTEB Russian v1.1 · Mean over tasks · Russian60#27
MTEB Russian v1.1 · Mean over task types · Russian57.3#30
MTEB Russian v1.1 · Classification · Russian63.4#34
MTEB Russian v1.1 · Clustering · Russian55.3#45
MTEB Russian v1.1 · Reranking · Russian54.7#59
MTEB Russian v1.1 · Multilabel Classification · Russian36.5#47
MTEB Russian v1.1 · STS · Russian71.2#44
MTEB Russian v1.1 · Retrieval · Russian64.4#29
MTEB Russian v1.1 · Pair Classification · Russian55.6#85
RTEB French beta · Mean over tasks · multilingual (2 languages)29.1#95
RTEB German beta · Mean over tasks · German48.8#68
RTEB Law beta · Mean over tasks · multilingual (4 languages)46#68
MTEB multilingual v2 · Retrieval · multilingual (120 languages)50.8#79
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)21.6#51
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)64.2#59
MTEB multilingual v2 · Instruction Reranking · English-2.6#151
MTEB multilingual v2 · Reranking · multilingual (22 languages)58.2#75
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)77.5#62

FAQ

How much does KaLM Embedding Multilingual Mini Instruct v1 cost?›

There is no per-unit API price: self-host only.

Is KaLM Embedding Multilingual Mini Instruct v1 free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is KaLM Embedding Multilingual Mini Instruct v1, and what is it best at?›

#131 of 200 in Embeddings.

Is KaLM Embedding Multilingual Mini Instruct v1 better than Arabic All Nli Triplet Matryoshka?›

On MTEB German v1 · Reranking · German, KaLM Embedding Multilingual Mini Instruct v1 scores 37.6 vs 40.1 — lower.

When was KaLM Embedding Multilingual Mini Instruct v1 released? Is there a newer version?›

Released 2024-10-23. It is the current version in its line.

Is KaLM Embedding Multilingual Mini Instruct v1 open source?›

Yes, the weights are open (MIT licence).

Can I run KaLM Embedding Multilingual Mini Instruct v1 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is KaLM Embedding Multilingual Mini Instruct v1?›

KaLM Embedding Multilingual Mini Instruct v1 is an open-weights embeddings & retrieval model from HIT-TMG, released Oct 2024.

What are the best alternatives to KaLM Embedding Multilingual Mini Instruct v1?›

Multilingual E5 Large (better), Nemotron 3 Embed 1B BF16 (open weights).