S

SFR Embedding Mistral

Jan 2024
SSFR Embedding Mistral
Compare in
on
self-host onlyprice
59.3MTEB English v2
Jan 2024released
4,096Dimensions
4K tokensMax input
enLanguages

Rankingconfiguration unstated?

Full ranking →
1Octen Law 8B v176.82MoD Embedding74.63Litil Embed 0.6B73.34Dinghy Law 8B v172.65Nemotron 3 Embed 8B BF1671.8
···
38Jasper Token Compression 600M55.439SFR Embedding Mistral55.340Bge M3 Custom Fr55.1

Strong at

A
Embeddings & Retrieval#28 of 200

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceCC BY-NC 4.0no commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English59.1#16
BEIR · Mean over task types · English59.1#16
BEIR · Retrieval · English59.1#16
BRIGHT · Mean over tasks · English18#7
BRIGHT · Mean over task types · English18#7
BRIGHT · Retrieval · English18#7
MTEB Persian v2 · Reranking · Persian71.9#12
JMTEB v2 · Clustering · Japanese55.4#12
JMTEB v2 · STS · Japanese83.6#17
LongEmbed · Mean over tasks · English44.3#52
LongEmbed · Mean over task types · English44.3#52
LongEmbed · Retrieval · English44.3#52
MTEB German v1 · Mean over tasks · German58.8#11
MTEB German v1 · Mean over task types · German57.7#9
MTEB German v1 · Classification · German72.8#22
MTEB German v1 · Pair Classification · German55.5#21
MTEB German v1 · STS · German69.6#28
MTEB German v1 · Clustering · German41.2#6
MTEB German v1 · Retrieval · German52.9#18
MTEB German v1 · Reranking · German54.4#7
MTEB Europe v1 · Classification · multilingual (23 languages)62.3#20
MTEB Europe v1 · Instruction Reranking · English0.2#56
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)20.6#18
MTEB Europe v1 · Pair Classification · multilingual (11 languages)89.8#24
MTEB Europe v1 · Clustering · multilingual (29 languages)47.7#25
MTEB Europe v1 · Retrieval · multilingual (25 languages)57.8#24
MTEB Europe v1 · Reranking · multilingual (12 languages)60.1#30
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)88.7#32
MTEB French v1 · Mean over tasks · multilingual (2 languages)67.2#9
MTEB French v1 · Mean over task types · multilingual (2 languages)65.4#8
MTEB French v1 · STS · French83.2#7
MTEB French v1 · Retrieval · multilingual (2 languages)65.8#8
MTEB French v1 · Classification · French73.8#18
MTEB French v1 · Clustering · French56.2#7
MTEB French v1 · Reranking · French85#12
MTEB French v1 · Pair Classification · French63.3#44
MTEB French v1 · Summarization · French30.4#59
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)59.4#38
MTEB Indic v1 · Mean over task types · multilingual (25 languages)57.8#35
MTEB Indic v1 · Classification · multilingual (8 languages)58.8#53
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)59.4#39
MTEB Indic v1 · STS · multilingual (13 languages)22.8#79
MTEB Indic v1 · Reranking · multilingual (2 languages)83.8#51
MTEB Indic v1 · Retrieval · multilingual (14 languages)77.9#33
MTEB Indic v1 · Pair Classification · Hindi69.4#62
MTEB Indic v1 · Clustering · multilingual (21 languages)32.8#59
MTEB Korean v2 · Classification · Korean61.6#18
MTEB Korean v2 · Reranking · Korean55.4#31
MTEB Dutch v1 · Mean over tasks · Dutch62.6#13
MTEB Dutch v1 · Mean over task types · Dutch67.5#12
MTEB Dutch v1 · Retrieval · Dutch64.4#14
MTEB Dutch v1 · Classification · Dutch68.8#15
MTEB Dutch v1 · Multilabel Classification · Dutch38.7#18
MTEB Dutch v1 · STS · Dutch82.7#13
MTEB Dutch v1 · Clustering · Dutch46.5#11
MTEB Dutch v1 · Reranking · Dutch91.6#16
MTEB Dutch v1 · Pair Classification · Dutch79.7#25
MTEB Polish v1 · Mean over tasks · Polish69.3#12
MTEB Polish v1 · Mean over task types · Polish68.3#11
MTEB Polish v1 · Classification · Polish68.2#18
MTEB Polish v1 · Clustering · Polish49#7
MTEB Polish v1 · STS · Polish69.9#12
MTEB Polish v1 · Pair Classification · Polish86.1#18
MTEB Portuguese v1 · Multilabel Classification · Portuguese19.9#84
MTEB Law v1 · Mean over tasks · multilingual (3 languages)55.3#39
MTEB Law v1 · Mean over task types · multilingual (3 languages)55.3#39
MTEB Law v1 · Retrieval · multilingual (3 languages)55.3#39
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)64.5#7
MTEB Medical v1 · Mean over task types · multilingual (10 languages)63#12
MTEB Medical v1 · Retrieval · multilingual (10 languages)67.8#4
MTEB Medical v1 · Clustering · English42.4#38
MTEB Medical v1 · Reranking · Mandarin Chinese78.9#59
FollowIR · Mean over tasks · English0.2#56
FollowIR · Mean over task types · English0.2#56
FollowIR · Instruction Reranking · English0.2#56
MTEB Spanish v1 · Clustering · Spanish48.8#18
MTEB Spanish v1 · Pair Classification · Spanish69.8#35
MTEB Spanish v1 · Reranking · Spanish61.8#17
MTEB Thai v1 · Pair Classification · Thai71#52
MTEB Thai v1 · Clustering · Thai53.1#37
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)63.7#11
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)64.3#12
MTEB Scandinavian v1 · Classification · multilingual (6 languages)65.1#18
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)69.5#16
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)51#11
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)71.6#36
MTEB Russian v1.1 · Classification · Russian69.8#19
MTEB Russian v1.1 · Clustering · Russian64.9#9
MTEB Russian v1.1 · Reranking · Russian70.5#8
MTEB Russian v1.1 · Multilabel Classification · Russian42.9#17
MTEB Russian v1.1 · STS · Russian74.3#16
MTEB Russian v1.1 · Pair Classification · Russian60.6#35
RTEB French beta · Mean over tasks · multilingual (2 languages)54.5#24
RTEB German beta · Mean over tasks · German45.1#81
RTEB Law beta · Mean over tasks · multilingual (4 languages)47.6#58
MTEB multilingual v2 · Clustering · multilingual (208 languages)51.8#29
MTEB multilingual v2 · Classification · multilingual (119 languages)60#42
MTEB multilingual v2 · Retrieval · multilingual (120 languages)59.4#44
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)24.5#33
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)70#35
MTEB multilingual v2 · Instruction Reranking · English0.2#56
MTEB multilingual v2 · Reranking · multilingual (22 languages)64.2#29
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)80.3#36

FAQ

How much does SFR Embedding Mistral cost?›

There is no per-unit API price: self-host only.

Is SFR Embedding Mistral free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is SFR Embedding Mistral, and what is it best at?›

#28 of 200 in Embeddings. Strongest at: Embeddings & Retrieval.

Is SFR Embedding Mistral better than Jasper Token Compression 600M?›

On MTEB Law v1 · Retrieval · multilingual (3 languages), SFR Embedding Mistral scores 55.3 vs 55.4 — about the same.

When was SFR Embedding Mistral released? Is there a newer version?›

Released 2024-01-24. It is the current version in its line.

Is SFR Embedding Mistral open source?›

Yes, the weights are open (cc-by-nc-4.0 licence).

Can I run SFR Embedding Mistral locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is SFR Embedding Mistral?›

SFR Embedding Mistral is an open-weights embeddings & retrieval model from Salesforce, released Jan 2024.

What are the best alternatives to SFR Embedding Mistral?›

Nemotron 3 Embed 1B BF16 (better), Octen Law 8B v1 (open weights).