E5 Mistral 7B Instruct

Feb 2024

iE5 Mistral 7B Instruct

Compare in

on

$0.022per 1M tokens

57.6MTEB English v2

Feb 2024released

4,096Dimensions

33K tokensMax input

enLanguages

Rankingconfiguration unstated?

Full ranking →

1Ja Embed Sts85.6 2F2LLM v2 8B85.4 3F2LLM v2 14B85.1 4Harrier OSS v1 0.6B84.8 5F2LLM v2 4B84.7

···

11Linq Embed Mistral83.9 12E5 Mistral 7B Instruct83.6 13Ruri Large v283.6

Strong at

A

Embeddings & Retrieval#41 of 200

Alternatives?

ModelScoreCostPriceWhat changes

CheaperEmbeddingGemma 300MunstatedOpen+1%-91%$0.002Max input: 33K tokens → 2K tokens+1 NOpenJa Embed Sts+2%——Max input: 33K tokens → 1K tokens iCheaperMultilingual E5 Large InstructunstatedOpensame-55%$0.01Max input: 33K tokens → 1K tokens iCheaperMultilingual E5 LargeunstatedOpen-3%-55%$0.01Max input: 33K tokens → 1K tokens

CheaperBge M3unstatedOpen-5%-55%$0.01Max input: 33K tokens → 8K tokens+1

Run it yourself

estimate

Fits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality

LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval

BEIR · Mean over tasks · English57.1#27

BEIR · Mean over task types · English57.1#27

BEIR · Retrieval · English57.1#27

BRIGHT · Mean over tasks · English17.5#11

BRIGHT · Mean over task types · English17.5#11

BRIGHT · Retrieval · English17.5#11

MTEB Mandarin Chinese v1 · Mean over tasks · Mandarin Chinese59.9#23

MTEB Mandarin Chinese v1 · Mean over task types · Mandarin Chinese60.5#24

MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese61.8#64

MTEB Mandarin Chinese v1 · STS · Mandarin Chinese48.3#47

MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese61.4#52

MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese52.3#42

MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese66.3#51

MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese73.1#21

MTEB Persian v2 · Mean over tasks · Persian60.7#21

MTEB Persian v2 · Mean over task types · Persian64.9#20

MTEB Persian v2 · STS · Persian79.4#7

MTEB Persian v2 · Clustering · Persian65.3#7

MTEB Persian v2 · Classification · Persian57.6#35

MTEB Persian v2 · Retrieval · Persian52.5#15

MTEB Persian v2 · Reranking · Persian71.9#14

MTEB Persian v2 · Bitext Mining · Persian44.5#31

MTEB Persian v2 · Pair Classification · Persian83.1#16

JMTEB v2 · Clustering · Japanese57#8

JMTEB v2 · STS · Japanese83.6#12

LongEmbed · Mean over tasks · English43.7#55

LongEmbed · Mean over task types · English43.7#55

LongEmbed · Retrieval · English43.7#55

MTEB German v1 · Mean over tasks · German58.3#9

MTEB German v1 · Mean over task types · German56.9#8

MTEB German v1 · Clustering · German40.9#8

MTEB German v1 · Retrieval · German52.9#15

MTEB German v1 · Classification · German72.5#20

MTEB German v1 · STS · German67.4#37

MTEB German v1 · Pair Classification · German55.2#20

MTEB German v1 · Reranking · German52.5#20

MTEB Europe v1 · Mean over tasks · multilingual (29 languages)61.3#12

MTEB Europe v1 · Mean over task types · multilingual (29 languages)54.5#12

MTEB Europe v1 · Retrieval · multilingual (25 languages)53.6#32

MTEB Europe v1 · STS · multilingual (8 languages)76.5#5

MTEB Europe v1 · Bitext Mining · multilingual (28 languages)85.5#54

MTEB Europe v1 · Classification · multilingual (23 languages)62.9#15

MTEB Europe v1 · Clustering · multilingual (29 languages)46.5#33

MTEB Europe v1 · Instruction Reranking · English-0.6#76

MTEB Europe v1 · Pair Classification · multilingual (11 languages)91.2#3

MTEB Europe v1 · Reranking · multilingual (12 languages)59.8#36

MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)15.5#60

MTEB French v1 · Mean over tasks · multilingual (2 languages)67.2#8

MTEB French v1 · Mean over task types · multilingual (2 languages)65.2#9

MTEB French v1 · STS · French82.4#9

MTEB French v1 · Retrieval · multilingual (2 languages)63.7#12

MTEB French v1 · Reranking · French84.7#9

MTEB French v1 · Clustering · French58.9#2

MTEB French v1 · Classification · French73.3#17

MTEB French v1 · Summarization · French31.1#34

MTEB French v1 · Pair Classification · French62.5#48

MTEB Indic v1 · Mean over tasks · multilingual (25 languages)60#31

MTEB Indic v1 · Mean over task types · multilingual (25 languages)58.4#27

MTEB Indic v1 · Classification · multilingual (8 languages)59.5#43

MTEB Indic v1 · Retrieval · multilingual (14 languages)77.3#31

MTEB Indic v1 · Bitext Mining · multilingual (20 languages)59.1#35

MTEB Indic v1 · Reranking · multilingual (2 languages)84.4#46

MTEB Indic v1 · Pair Classification · Hindi73#50

MTEB Indic v1 · STS · multilingual (13 languages)23#77

MTEB Indic v1 · Clustering · multilingual (21 languages)32.7#61

MTEB Korean v2 · STS · Korean84.5#11

MTEB Korean v2 · Reranking · Korean56.2#26

MTEB Korean v2 · Classification · Korean60.1#23

MTEB Dutch v1 · Classification · Dutch62.4#29

MTEB Dutch v1 · Clustering · Dutch28.6#59

MTEB Dutch v1 · STS · Dutch71.5#60

MTEB Dutch v1 · Multilabel Classification · Dutch33.5#59

MTEB Dutch v1 · Pair Classification · Dutch72.7#56

MTEB Dutch v1 · Reranking · Dutch91.5#17

MTEB Polish v1 · Pair Classification · Polish87.1#8

MTEB Polish v1 · Classification · Polish69.5#13

MTEB Polish v1 · STS · Polish69.3#14

MTEB Portuguese v1 · Classification · Portuguese65.5#3

MTEB Portuguese v1 · Multilabel Classification · Portuguese19#111

MTEB Law v1 · Mean over tasks · multilingual (3 languages)54.3#40

MTEB Law v1 · Mean over task types · multilingual (3 languages)54.3#40

MTEB Law v1 · Retrieval · multilingual (3 languages)54.3#40

MTEB Medical v1 · Clustering · English38.4#60

MTEB Medical v1 · Reranking · Mandarin Chinese77.6#62

FollowIR · Mean over tasks · English-0.6#76

FollowIR · Mean over task types · English-0.6#76

FollowIR · Instruction Reranking · English-0.6#76

MTEB Spanish v1 · Pair Classification · Spanish71.6#24

MTEB Spanish v1 · STS · multilingual (2 languages)79.4#10

MTEB Spanish v1 · Clustering · Spanish49#17

MTEB Spanish v1 · Reranking · Spanish61.1#25

MTEB Thai v1 · Clustering · Thai53.4#36

MTEB Thai v1 · Classification · Thai63.1#22

MTEB Thai v1 · Pair Classification · Thai75.3#40

MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)62#11

MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)63.4#8

MTEB Scandinavian v1 · Clustering · multilingual (2 languages)51.4#4

MTEB Scandinavian v1 · Classification · multilingual (6 languages)64.9#18

MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)61.9#33

MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)75.2#18

VN-MTEB Vietnamese v1 · Classification · Vietnamese62.3#19

VN-MTEB Vietnamese v1 · STS · Vietnamese81.2#8

VN-MTEB Vietnamese v1 · Retrieval · Vietnamese41.7#6

VN-MTEB Vietnamese v1 · Clustering · Vietnamese49#11

VN-MTEB Vietnamese v1 · Reranking · Vietnamese66.1#8

MTEB Russian v1.1 · Mean over tasks · Russian67#13

MTEB Russian v1.1 · Mean over task types · Russian64.9#12

MTEB Russian v1.1 · Classification · Russian69.1#21

MTEB Russian v1.1 · STS · Russian73.7#25

MTEB Russian v1.1 · Reranking · Russian70#13

MTEB Russian v1.1 · Clustering · Russian64.2#14

MTEB Russian v1.1 · Pair Classification · Russian60.8#32

MTEB Russian v1.1 · Retrieval · Russian73.3#14

MTEB Russian v1.1 · Multilabel Classification · Russian42.9#18

RTEB Finnish beta · Mean over tasks · English51#68

RTEB French beta · Mean over tasks · multilingual (2 languages)54.4#24

RTEB German beta · Mean over tasks · German44.4#75

RTEB Health beta · Mean over tasks · multilingual (4 languages)61.2#29

RTEB Law beta · Mean over tasks · multilingual (4 languages)46.6#57

MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)60#36

MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)52.8#35

MTEB multilingual v2 · Classification · multilingual (119 languages)60.3#40

MTEB multilingual v2 · Clustering · multilingual (208 languages)50.6#36

MTEB multilingual v2 · STS · multilingual (35 languages)74#34

MTEB multilingual v2 · Pair Classification · multilingual (24 languages)81.1#25

MTEB multilingual v2 · Retrieval · multilingual (120 languages)55.8#63

MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)68.4#46

MTEB multilingual v2 · Instruction Reranking · English-0.6#76

MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)22.2#46

MTEB multilingual v2 · Reranking · multilingual (22 languages)63.8#34

FAQ

How much does E5 Mistral 7B Instruct cost?›

$0.022 per 1M tokens.

Is E5 Mistral 7B Instruct free to use?›

There is no free API; it costs $0.022 per 1M tokens. The weights are open, so you can run it yourself.

How good is E5 Mistral 7B Instruct, and what is it best at?›

#41 of 200 in Embeddings. Strongest at: Embeddings & Retrieval.

Is E5 Mistral 7B Instruct better than Linq Embed Mistral?›

On JMTEB v2 · STS · Japanese, E5 Mistral 7B Instruct scores 83.6 vs 83.9 — about the same.

When was E5 Mistral 7B Instruct released? Is there a newer version?›

Released 2024-02-08. It is the current version in its line.

Is E5 Mistral 7B Instruct open source?›

Yes, the weights are open (MIT licence).

Can I run E5 Mistral 7B Instruct locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is E5 Mistral 7B Instruct?›

E5 Mistral 7B Instruct is an open-weights embeddings & retrieval model from intfloat, released Feb 2024.

What are the best alternatives to E5 Mistral 7B Instruct?›

EmbeddingGemma 300M (cheaper), Ja Embed Sts (open weights).