H

KaLM Embedding Multilingual Mini Instruct v1.5

Dec 2024
HKaLM Embedding Multilingual Mini Instruct v1.5
Compare in
on
self-host onlyprice
83.4MTEB English v2
Dec 2024released
896Dimensions
33K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B72.52F2LLM v2 8B71.43Inf Retriever v169.54F2LLM v2 4B69.15GritLM 7B65.9
···
24F2LLM v2 330M55.825KaLM Embedding Multilingual Mini Instruct v1.554.326KaLM Embedding Multilingual Mini Instruct v153.8

Alternatives?

ModelScoreCostPriceWhat changes
iBetterMultilingual E5 Large InstructunstatedOpen+11%—$0.01Max input: 33K tokens → 1K tokenscOpenF2LLM v2 8Bunstated+32%——Memory (4-bit): 0.3 GB → 4.5 GBiBetterE5 Mistral 7B InstructunstatedOpen+17%—$0.022Memory (4-bit): 0.3 GB → 4.3 GBBetterJina Embeddings v3unstatedOpen+10%—$0.05Max input: 33K tokens → 8K tokenscBetterF2LLM v2 14BunstatedOpen+34%——Memory (4-bit): 0.3 GB → 8.4 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

History

3 versions
53.853.95454.154.254.3Release dateMTEB French · Retrievalv1v1.5
53.853.95454.154.254.3Release dateMTEB French · Retrievalv1v1.5

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English51.6#84
BEIR · Mean over task types · English51.6#84
BEIR · Retrieval · English51.6#84
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese70.1#47
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese48.4#46
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese64.4#47
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese57.3#35
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese72.9#40
MTEB French v1 · Retrieval · multilingual (2 languages)54.3#25
MTEB French v1 · Reranking · French80.6#25
MTEB French v1 · Summarization · French29.3#113
MTEB Polish v1 · Pair Classification · Polish79.1#55
MTEB Polish v1 · STS · Polish67#28
MTEB Medical v1 · Reranking · Mandarin Chinese83.1#41
MTEB Russian v1.1 · STS · Russian70.7#46
MTEB Russian v1.1 · Reranking · Russian63.7#37
MTEB Russian v1.1 · Clustering · Russian55.9#37
MTEB Russian v1.1 · Pair Classification · Russian55.2#89
MTEB Russian v1.1 · Retrieval · Russian63.9#31
MTEB Russian v1.1 · Multilabel Classification · Russian37.7#36

FAQ

How much does KaLM Embedding Multilingual Mini Instruct v1.5 cost?›

There is no per-unit API price: self-host only.

Is KaLM Embedding Multilingual Mini Instruct v1.5 free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is KaLM Embedding Multilingual Mini Instruct v1.5, and what is it best at?›

#136 of 238 in Embeddings.

Is KaLM Embedding Multilingual Mini Instruct v1.5 better than F2LLM v2 330M?›

On MTEB French v1 · Retrieval · multilingual (2 languages), KaLM Embedding Multilingual Mini Instruct v1.5 scores 54.3 vs 55.8 — lower.

When was KaLM Embedding Multilingual Mini Instruct v1.5 released? Is there a newer version?›

Released 2024-12-26. It is the current version in its line.

Is KaLM Embedding Multilingual Mini Instruct v1.5 open source?›

Yes, the weights are open (MIT licence).

Can I run KaLM Embedding Multilingual Mini Instruct v1.5 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is KaLM Embedding Multilingual Mini Instruct v1.5?›

KaLM Embedding Multilingual Mini Instruct v1.5 is an open-weights embeddings & retrieval model from HIT-TMG, released Dec 2024.

What are the best alternatives to KaLM Embedding Multilingual Mini Instruct v1.5?›

Multilingual E5 Large Instruct (better), F2LLM v2 8B (open weights).