H

KaLM Embedding Multilingual Mini Instruct v1.5

Dec 2024
HKaLM Embedding Multilingual Mini Instruct v1.5
Compare in
on
self-host onlyprice
83.4MTEB English v2
Dec 2024released
896Dimensions
33K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B68.92Gte Qwen2 7B Instruct68.53F2LLM v2 8B68.14F2LLM v2 4B67.85Gte Qwen1.5 7B Instruct66
···
16Linq Embed Mistral61.917KaLM Embedding Multilingual Mini Instruct v1.561.918Stella En 1.5B v561.8

Alternatives?

ModelScoreCostPriceWhat changes
cBetterF2LLM v2 14BunstatedOpen+11%——Memory (4-bit): 0.3 GB → 8.4 GBOpenGte Qwen2 7B Instructunstated+11%——Memory (4-bit): 0.3 GB → 4.2 GBcBetterF2LLM v2 8BunstatedOpen+10%——Memory (4-bit): 0.3 GB → 4.5 GBcBetterF2LLM v2 4BunstatedOpen+10%——Memory (4-bit): 0.3 GB → 2.4 GBBetterGte Qwen1.5 7B InstructunstatedOpen+7%——Memory (4-bit): 0.3 GB → 4.3 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

History

3 versions
59606162Release dateMTEB Medical v1v1v1.5
59606162Release dateMTEB Medical v1v1v1.5

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English51.6#86
BEIR · Mean over task types · English51.6#86
BEIR · Retrieval · English51.6#86
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese48.4#50
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese57.3#39
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese64.4#47
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese70.1#48
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese72.9#40
MTEB French v1 · Retrieval · multilingual (2 languages)54.3#30
MTEB French v1 · Reranking · French80.6#32
MTEB French v1 · Summarization · French29.3#117
MTEB Polish v1 · Clustering · Polish44.3#20
MTEB Polish v1 · STS · Polish67#33
MTEB Polish v1 · Pair Classification · Polish79.1#63
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)59.7#23
MTEB Medical v1 · Mean over task types · multilingual (10 languages)61.9#17
MTEB Medical v1 · Retrieval · multilingual (10 languages)61.2#26
MTEB Medical v1 · Clustering · English41.4#47
MTEB Medical v1 · Reranking · Mandarin Chinese83.1#45
MTEB Spanish v1 · Classification · Spanish88.5#22
MTEB Russian v1.1 · Clustering · Russian55.9#42
MTEB Russian v1.1 · Reranking · Russian63.7#37
MTEB Russian v1.1 · Multilabel Classification · Russian37.7#41
MTEB Russian v1.1 · STS · Russian70.7#48
MTEB Russian v1.1 · Retrieval · Russian63.9#31
MTEB Russian v1.1 · Pair Classification · Russian55.2#89
RTEB French beta · Mean over tasks · multilingual (2 languages)36.1#80

FAQ

How much does KaLM Embedding Multilingual Mini Instruct v1.5 cost?›

There is no per-unit API price: self-host only.

Is KaLM Embedding Multilingual Mini Instruct v1.5 free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is KaLM Embedding Multilingual Mini Instruct v1.5, and what is it best at?›

#136 of 238 in Embeddings.

Is KaLM Embedding Multilingual Mini Instruct v1.5 better than Linq Embed Mistral?›

On MTEB Medical v1 · Mean over task types · multilingual (10 languages), KaLM Embedding Multilingual Mini Instruct v1.5 scores 61.9 vs 61.9 — about the same.

When was KaLM Embedding Multilingual Mini Instruct v1.5 released? Is there a newer version?›

Released 2024-12-26. It is the current version in its line.

Is KaLM Embedding Multilingual Mini Instruct v1.5 open source?›

Yes, the weights are open (MIT licence).

Can I run KaLM Embedding Multilingual Mini Instruct v1.5 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is KaLM Embedding Multilingual Mini Instruct v1.5?›

KaLM Embedding Multilingual Mini Instruct v1.5 is an open-weights embeddings & retrieval model from HIT-TMG, released Dec 2024.

What are the best alternatives to KaLM Embedding Multilingual Mini Instruct v1.5?›

F2LLM v2 14B (better), Gte Qwen2 7B Instruct (open weights).