S

SFR Embedding 2 R

Jun 2024
SSFR Embedding 2 R
Compare in
on
self-host onlyprice
53.8MTEB English v2
Jun 2024released
4,096Dimensions
4K tokensMax input
enLanguages

Rankingconfiguration unstated?

Full ranking →
1Octen Law 8B v176.82Litil Embed 0.6B73.33Dinghy Law 8B v172.64Dinghy Law 4B v171.25Euler Legal Embedding v170.4
···
29Text Embedding 3 Small56.330SFR Embedding 2 R55.831Gte Qwen2 1.5B Instruct55.6

Strong at

B
Embeddings & Retrieval#71 of 200

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceCC BY-NC 4.0no commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English59.8#12
BEIR · Mean over task types · English59.8#12
BEIR · Retrieval · English59.8#12
MTEB Persian v2 · Reranking · Persian70.5#21
JMTEB v2 · Clustering · Japanese52.2#22
JMTEB v2 · STS · Japanese82#27
LongEmbed · Mean over tasks · English45.9#49
LongEmbed · Mean over task types · English45.9#49
LongEmbed · Retrieval · English45.9#49
MTEB German v1 · Clustering · German40.1#11
MTEB German v1 · Classification · German78.5#13
MTEB German v1 · STS · German63.8#45
MTEB German v1 · Pair Classification · German52.8#47
MTEB German v1 · Reranking · German53.4#14
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)62.3#9
MTEB Europe v1 · Mean over task types · multilingual (29 languages)55.5#9
MTEB Europe v1 · Retrieval · multilingual (25 languages)56.7#19
MTEB Europe v1 · STS · multilingual (8 languages)72.9#25
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)88.5#34
MTEB Europe v1 · Classification · multilingual (23 languages)63.9#9
MTEB Europe v1 · Clustering · multilingual (29 languages)49.3#15
MTEB Europe v1 · Instruction Reranking · English-1.8#117
MTEB Europe v1 · Pair Classification · multilingual (11 languages)88.9#25
MTEB Europe v1 · Reranking · multilingual (12 languages)59.7#38
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)21.4#15
MTEB French v1 · Mean over tasks · multilingual (2 languages)67.8#7
MTEB French v1 · Mean over task types · multilingual (2 languages)64.9#10
MTEB French v1 · STS · French79.3#16
MTEB French v1 · Retrieval · multilingual (2 languages)64.3#9
MTEB French v1 · Reranking · French83.1#14
MTEB French v1 · Clustering · French57.6#4
MTEB French v1 · Classification · French79.3#10
MTEB French v1 · Summarization · French30.6#51
MTEB French v1 · Pair Classification · French60.2#71
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)59.8#32
MTEB Indic v1 · Mean over task types · multilingual (25 languages)55.6#37
MTEB Indic v1 · Classification · multilingual (8 languages)61.3#33
MTEB Indic v1 · Retrieval · multilingual (14 languages)76.4#35
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)54.3#38
MTEB Indic v1 · Reranking · multilingual (2 languages)83.2#59
MTEB Indic v1 · Pair Classification · Hindi67.6#71
MTEB Indic v1 · STS · multilingual (13 languages)21.7#82
MTEB Indic v1 · Clustering · multilingual (21 languages)24.9#79
MTEB Korean v2 · STS · Korean81.2#23
MTEB Korean v2 · Reranking · Korean54.6#31
MTEB Korean v2 · Classification · Korean56.8#37
MTEB Dutch v1 · Mean over tasks · Dutch63.5#10
MTEB Dutch v1 · Mean over task types · Dutch67.7#10
MTEB Dutch v1 · Classification · Dutch70.1#12
MTEB Dutch v1 · Clustering · Dutch49.3#5
MTEB Dutch v1 · Retrieval · Dutch64.5#13
MTEB Dutch v1 · STS · Dutch79.2#31
MTEB Dutch v1 · Multilabel Classification · Dutch41.2#6
MTEB Dutch v1 · Pair Classification · Dutch79.1#27
MTEB Dutch v1 · Reranking · Dutch90.4#29
MTEB Polish v1 · Pair Classification · Polish82.6#37
MTEB Polish v1 · Classification · Polish70.6#10
MTEB Polish v1 · STS · Polish68.3#20
MTEB Portuguese v1 · Multilabel Classification · Portuguese22.9#23
MTEB Law v1 · Mean over tasks · multilingual (3 languages)55.8#30
MTEB Law v1 · Mean over task types · multilingual (3 languages)55.8#30
MTEB Law v1 · Retrieval · multilingual (3 languages)55.8#30
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)64.3#8
MTEB Medical v1 · Mean over task types · multilingual (10 languages)63.6#9
MTEB Medical v1 · Retrieval · multilingual (10 languages)66.6#9
MTEB Medical v1 · Clustering · English48.2#16
MTEB Medical v1 · Reranking · Mandarin Chinese76.1#65
FollowIR · Mean over tasks · English-1.8#117
FollowIR · Mean over task types · English-1.8#117
FollowIR · Instruction Reranking · English-1.8#117
MTEB Spanish v1 · Pair Classification · Spanish66.2#58
MTEB Spanish v1 · STS · multilingual (2 languages)77.8#23
MTEB Spanish v1 · Clustering · Spanish51.5#10
MTEB Spanish v1 · Reranking · Spanish60.4#32
MTEB Thai v1 · Clustering · Thai47.2#43
MTEB Thai v1 · Pair Classification · Thai67.9#70
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)65.6#5
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)65.7#5
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)53#1
MTEB Scandinavian v1 · Classification · multilingual (6 languages)68.2#10
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)69.6#14
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)71.9#34
MTEB Russian v1.1 · Classification · Russian70.2#16
MTEB Russian v1.1 · STS · Russian70#49
MTEB Russian v1.1 · Reranking · Russian68.2#23
MTEB Russian v1.1 · Clustering · Russian64.9#10
MTEB Russian v1.1 · Pair Classification · Russian58.5#52
MTEB Russian v1.1 · Multilabel Classification · Russian42.6#20
RTEB French beta · Mean over tasks · multilingual (2 languages)50.8#38
RTEB German beta · Mean over tasks · German44.2#76
RTEB Law beta · Mean over tasks · multilingual (4 languages)47.9#47
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)59.8#37
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)52.8#37
MTEB multilingual v2 · Classification · multilingual (119 languages)59#44
MTEB multilingual v2 · Clustering · multilingual (208 languages)53.7#18
MTEB multilingual v2 · STS · multilingual (35 languages)71#48
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)78.6#53
MTEB multilingual v2 · Retrieval · multilingual (120 languages)57.9#52
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)68.8#44
MTEB multilingual v2 · Instruction Reranking · English-1.8#117
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)25.2#27
MTEB multilingual v2 · Reranking · multilingual (22 languages)63#42

FAQ

How much does SFR Embedding 2 R cost?›

There is no per-unit API price: self-host only.

Is SFR Embedding 2 R free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is SFR Embedding 2 R, and what is it best at?›

#71 of 200 in Embeddings.

Is SFR Embedding 2 R better than Text Embedding 3 Small?›

On MTEB Law v1 · Retrieval · multilingual (3 languages), SFR Embedding 2 R scores 55.8 vs 56.3 — about the same.

When was SFR Embedding 2 R released? Is there a newer version?›

Released 2024-06-14. It is the current version in its line.

Is SFR Embedding 2 R open source?›

Yes, the weights are open (cc-by-nc-4.0 licence).

Can I run SFR Embedding 2 R locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is SFR Embedding 2 R?›

SFR Embedding 2 R is an open-weights embeddings & retrieval model from Salesforce, released Jun 2024.

What are the best alternatives to SFR Embedding 2 R?›

Voyage 3 Lite (better), Octen Law 8B v1 (open weights).