SFR Embedding 2 R

Name: SFR Embedding 2 R
Brand: Salesforce

Jun 2024

SSFR Embedding 2 R

Compare in

self-host onlyprice

53.8MTEB English v2

Jun 2024released

4,096Dimensions

4K tokensMax input

enLanguages

Rankingconfiguration unstated?

Full ranking →

1Gte Qwen2 7B Instruct65.3 2German Semantic STS v263.2 3Gte Qwen1.5 7B Instruct62 4F2LLM v2 14B59.8 5F2LLM v2 8B59.1

···

46Granite Embedding 278M Multilingual52.8 47SFR Embedding 2 R52.8 48Sgpt Bloom 7b1 Msmarco52.8

Strong at

Embeddings & Retrieval#71 of 200

Alternatives?

ModelScoreCostPriceWhat changes

BetterJina Embeddings v5 Text NanounstatedOpen+6%—$0.02Languages: not verified

OpenGte Qwen2 7B Instructunstated+24%——Languages: not verified iBetterE5 Mistral 7B InstructunstatedOpen+4%—$0.022

BetterJina Embeddings v5 Text SmallunstatedOpen+11%—$0.05Languages: not verified VBetterVoyage Large 2 Instructunstated+5%—$0.12Languages: not verified

Run it yourself

estimate

Fits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality

LicenceCC BY-NC 4.0no commercial use

Benchmarks

in Embeddings & Retrieval

BEIR · Mean over tasks · English59.8#12

BEIR · Mean over task types · English59.8#12

BEIR · Retrieval · English59.8#12

MTEB Persian v2 · Reranking · Persian70.5#21

JMTEB v2 · Clustering · Japanese52.2#22

JMTEB v2 · STS · Japanese82#27

LongEmbed · Mean over tasks · English45.9#49

LongEmbed · Mean over task types · English45.9#49

LongEmbed · Retrieval · English45.9#49

MTEB German v1 · Clustering · German40.1#11

MTEB German v1 · Classification · German78.5#13

MTEB German v1 · STS · German63.8#45

MTEB German v1 · Pair Classification · German52.8#47

MTEB German v1 · Reranking · German53.4#14

MTEB Europe v1 · Mean over tasks · multilingual (29 languages)62.3#9

MTEB Europe v1 · Mean over task types · multilingual (29 languages)55.5#9

MTEB Europe v1 · Retrieval · multilingual (25 languages)56.7#19

MTEB Europe v1 · STS · multilingual (8 languages)72.9#25

MTEB Europe v1 · Bitext Mining · multilingual (28 languages)88.5#34

MTEB Europe v1 · Classification · multilingual (23 languages)63.9#9

MTEB Europe v1 · Clustering · multilingual (29 languages)49.3#15

MTEB Europe v1 · Instruction Reranking · English-1.8#117

MTEB Europe v1 · Pair Classification · multilingual (11 languages)88.9#25

MTEB Europe v1 · Reranking · multilingual (12 languages)59.7#38

MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)21.4#15

MTEB French v1 · Mean over tasks · multilingual (2 languages)67.8#7

MTEB French v1 · Mean over task types · multilingual (2 languages)64.9#10

MTEB French v1 · STS · French79.3#16

MTEB French v1 · Retrieval · multilingual (2 languages)64.3#9

MTEB French v1 · Reranking · French83.1#14

MTEB French v1 · Clustering · French57.6#4

MTEB French v1 · Classification · French79.3#10

MTEB French v1 · Summarization · French30.6#51

MTEB French v1 · Pair Classification · French60.2#71

MTEB Indic v1 · Mean over tasks · multilingual (25 languages)59.8#32

MTEB Indic v1 · Mean over task types · multilingual (25 languages)55.6#37

MTEB Indic v1 · Classification · multilingual (8 languages)61.3#33

MTEB Indic v1 · Retrieval · multilingual (14 languages)76.4#35

MTEB Indic v1 · Bitext Mining · multilingual (20 languages)54.3#38

MTEB Indic v1 · Reranking · multilingual (2 languages)83.2#59

MTEB Indic v1 · Pair Classification · Hindi67.6#71

MTEB Indic v1 · STS · multilingual (13 languages)21.7#82

MTEB Indic v1 · Clustering · multilingual (21 languages)24.9#79

MTEB Korean v2 · STS · Korean81.2#23

MTEB Korean v2 · Reranking · Korean54.6#31

MTEB Korean v2 · Classification · Korean56.8#37

MTEB Dutch v1 · Mean over tasks · Dutch63.5#10

MTEB Dutch v1 · Mean over task types · Dutch67.7#10

MTEB Dutch v1 · Classification · Dutch70.1#12

MTEB Dutch v1 · Clustering · Dutch49.3#5

MTEB Dutch v1 · Retrieval · Dutch64.5#13

MTEB Dutch v1 · STS · Dutch79.2#31

MTEB Dutch v1 · Multilabel Classification · Dutch41.2#6

MTEB Dutch v1 · Pair Classification · Dutch79.1#27

MTEB Dutch v1 · Reranking · Dutch90.4#29

MTEB Polish v1 · Pair Classification · Polish82.6#37

MTEB Polish v1 · Classification · Polish70.6#10

MTEB Polish v1 · STS · Polish68.3#20

MTEB Portuguese v1 · Multilabel Classification · Portuguese22.9#23

MTEB Law v1 · Mean over tasks · multilingual (3 languages)55.8#30

MTEB Law v1 · Mean over task types · multilingual (3 languages)55.8#30

MTEB Law v1 · Retrieval · multilingual (3 languages)55.8#30

MTEB Medical v1 · Mean over tasks · multilingual (10 languages)64.3#8

MTEB Medical v1 · Mean over task types · multilingual (10 languages)63.6#9

MTEB Medical v1 · Retrieval · multilingual (10 languages)66.6#9

MTEB Medical v1 · Clustering · English48.2#16

MTEB Medical v1 · Reranking · Mandarin Chinese76.1#65

FollowIR · Mean over tasks · English-1.8#117

FollowIR · Mean over task types · English-1.8#117

FollowIR · Instruction Reranking · English-1.8#117

MTEB Spanish v1 · Pair Classification · Spanish66.2#58

MTEB Spanish v1 · STS · multilingual (2 languages)77.8#23

MTEB Spanish v1 · Clustering · Spanish51.5#10

MTEB Spanish v1 · Reranking · Spanish60.4#32

MTEB Thai v1 · Clustering · Thai47.2#43

MTEB Thai v1 · Pair Classification · Thai67.9#70

MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)65.6#5

MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)65.7#5

MTEB Scandinavian v1 · Clustering · multilingual (2 languages)53#1

MTEB Scandinavian v1 · Classification · multilingual (6 languages)68.2#10

MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)69.6#14

MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)71.9#34

MTEB Russian v1.1 · Classification · Russian70.2#16

MTEB Russian v1.1 · STS · Russian70#49

MTEB Russian v1.1 · Reranking · Russian68.2#23

MTEB Russian v1.1 · Clustering · Russian64.9#10

MTEB Russian v1.1 · Pair Classification · Russian58.5#52

MTEB Russian v1.1 · Multilabel Classification · Russian42.6#20

RTEB French beta · Mean over tasks · multilingual (2 languages)50.8#38

RTEB German beta · Mean over tasks · German44.2#76

RTEB Law beta · Mean over tasks · multilingual (4 languages)47.9#47

MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)59.8#37

MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)52.8#37

MTEB multilingual v2 · Classification · multilingual (119 languages)59#44

MTEB multilingual v2 · Clustering · multilingual (208 languages)53.7#18

MTEB multilingual v2 · STS · multilingual (35 languages)71#48

MTEB multilingual v2 · Pair Classification · multilingual (24 languages)78.6#53

MTEB multilingual v2 · Retrieval · multilingual (120 languages)57.9#52

MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)68.8#44

MTEB multilingual v2 · Instruction Reranking · English-1.8#117

MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)25.2#27

MTEB multilingual v2 · Reranking · multilingual (22 languages)63#42

FAQ

How much does SFR Embedding 2 R cost?›

There is no per-unit API price: self-host only.

Is SFR Embedding 2 R free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is SFR Embedding 2 R, and what is it best at?›

#71 of 200 in Embeddings.

Is SFR Embedding 2 R better than Granite Embedding 278M Multilingual?›

On MTEB German v1 · Pair Classification · German, SFR Embedding 2 R scores 52.8 vs 52.8 — about the same.

When was SFR Embedding 2 R released? Is there a newer version?›

Released 2024-06-14. It is the current version in its line.

Is SFR Embedding 2 R open source?›

Yes, the weights are open (cc-by-nc-4.0 licence).

Can I run SFR Embedding 2 R locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is SFR Embedding 2 R?›

SFR Embedding 2 R is an open-weights embeddings & retrieval model from Salesforce, released Jun 2024.

What are the best alternatives to SFR Embedding 2 R?›

Jina Embeddings v5 Text Nano (better), Gte Qwen2 7B Instruct (open weights).