Multilingual E5 Large Instruct

Feb 2024

iMultilingual E5 Large Instruct

Compare in

on

$0.01per 1M tokens

53.5MTEB English v2

Feb 2024released

1,024Dimensions

1K tokensMax input

en, Esperanto, es +90Languages

Rankingconfiguration unstated?

Full ranking →

1Gemini Embedding 00183 2Jina Embeddings v5 Omni Small82.5 3Jina Embeddings v5 Text Small82.5 4Jina Embeddings v5 Omni Nano81.7 4Jina Embeddings v5 Text Nano81.7 6Multilingual E5 Large Instruct80.1 7Gte Qwen2 7B Instruct79.8

Strong at

B

Embeddings & Retrieval#75 of 200

Alternatives?

ModelScoreCostPriceWhat changes

BetterJina Embeddings v5 Text SmallunstatedOpen+3%+400%$0.05Languages: not verified+1

BetterGemini Embedding 001unstated+4%+1,400%$0.15Languages: not verified

OpenJina Embeddings v5 Text Nanounstated+2%+100%$0.02Languages: not verified

OpenGte Qwen2 7B Instructunstatedsame——Languages: not verified+1 cOpenF2LLM v2 0.6Bunstatedsame——Languages: loses Assamese, Western Frisian, Scottish Gaelic +12+1

Run it yourself

estimate

Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality

LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval

BEIR · Mean over tasks · English52.7#70

BEIR · Mean over task types · English52.7#70

BEIR · Retrieval · English52.7#70

BEIR-NL · Mean over tasks · Dutch44.4#6

BEIR-NL · Mean over task types · Dutch44.4#6

BEIR-NL · Retrieval · Dutch44.4#6

MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese64.9#58

MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese60.7#56

MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese70.8#25

MTEB Persian v2 · Reranking · Persian72.4#9

JMTEB v2 · Clustering · Japanese54.4#13

JMTEB v2 · STS · Japanese82.9#21

LongEmbed · Mean over tasks · English41.8#64

LongEmbed · Mean over task types · English41.8#64

LongEmbed · Retrieval · English41.8#64

MTEB German v1 · Mean over tasks · German57.1#11

MTEB German v1 · Mean over task types · German55.8#11

MTEB German v1 · Clustering · German40.2#10

MTEB German v1 · Retrieval · German51.9#18

MTEB German v1 · Classification · German69.5#25

MTEB German v1 · STS · German73.7#9

MTEB German v1 · Pair Classification · German53.1#42

MTEB German v1 · Reranking · German46.6#40

MTEB Europe v1 · Mean over tasks · multilingual (29 languages)62.2#10

MTEB Europe v1 · Mean over task types · multilingual (29 languages)55.3#10

MTEB Europe v1 · Retrieval · multilingual (25 languages)54.8#26

MTEB Europe v1 · STS · multilingual (8 languages)77.4#2

MTEB Europe v1 · Bitext Mining · multilingual (28 languages)90.4#15

MTEB Europe v1 · Classification · multilingual (23 languages)63.2#10

MTEB Europe v1 · Clustering · multilingual (29 languages)46.9#31

MTEB Europe v1 · Instruction Reranking · English-0.4#69

MTEB Europe v1 · Pair Classification · multilingual (11 languages)89.9#11

MTEB Europe v1 · Reranking · multilingual (12 languages)58.4#47

MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)17.3#45

MTEB French v1 · Mean over tasks · multilingual (2 languages)64.6#12

MTEB French v1 · Mean over task types · multilingual (2 languages)63.2#12

MTEB French v1 · STS · French83#7

MTEB French v1 · Retrieval · multilingual (2 languages)60.5#15

MTEB French v1 · Reranking · French82.3#17

MTEB French v1 · Clustering · French56.1#9

MTEB French v1 · Classification · French69.4#22

MTEB French v1 · Summarization · French31.7#14

MTEB French v1 · Pair Classification · French59.4#76

MTEB Indic v1 · Mean over tasks · multilingual (25 languages)70.2#7

MTEB Indic v1 · Mean over task types · multilingual (25 languages)71.6#7

MTEB Indic v1 · Classification · multilingual (8 languages)67#10

MTEB Indic v1 · Retrieval · multilingual (14 languages)84.9#10

MTEB Indic v1 · Bitext Mining · multilingual (20 languages)80.4#1

MTEB Indic v1 · Reranking · multilingual (2 languages)87.5#16

MTEB Indic v1 · Pair Classification · Hindi76.3#32

MTEB Indic v1 · STS · multilingual (13 languages)53.7#16

MTEB Indic v1 · Clustering · multilingual (21 languages)51.7#15

MTEB Korean v2 · STS · Korean85.2#8

MTEB Korean v2 · Reranking · Korean52.3#42

MTEB Korean v2 · Classification · Korean62.2#15

MTEB Dutch v1 · Mean over tasks · Dutch58.4#20

MTEB Dutch v1 · Mean over task types · Dutch65.5#15

MTEB Dutch v1 · Classification · Dutch64.7#21

MTEB Dutch v1 · Clustering · Dutch45.4#14

MTEB Dutch v1 · Retrieval · Dutch55.1#46

MTEB Dutch v1 · STS · Dutch82.3#15

MTEB Dutch v1 · Multilabel Classification · Dutch38.6#20

MTEB Dutch v1 · Pair Classification · Dutch81.5#8

MTEB Dutch v1 · Reranking · Dutch91.1#22

MTEB Polish v1 · Pair Classification · Polish87.2#7

MTEB Polish v1 · Classification · Polish67#17

MTEB Polish v1 · STS · Polish70.3#8

MTEB Portuguese v1 · Mean over tasks · Portuguese72.2#2

MTEB Portuguese v1 · Mean over task types · Portuguese65.7#3

MTEB Portuguese v1 · Classification · Portuguese64.6#4

MTEB Portuguese v1 · Retrieval · Portuguese75.8#6

MTEB Portuguese v1 · Multilabel Classification · Portuguese20.1#75

MTEB Portuguese v1 · STS · Portuguese82.3#6

MTEB Portuguese v1 · Reranking · Portuguese85.9#1

MTEB Law v1 · Mean over tasks · multilingual (3 languages)54.9#37

MTEB Law v1 · Mean over task types · multilingual (3 languages)54.9#37

MTEB Law v1 · Retrieval · multilingual (3 languages)54.9#37

MTEB Medical v1 · Clustering · English37.9#64

MTEB Medical v1 · Reranking · Mandarin Chinese76#66

FollowIR · Mean over tasks · English-0.4#69

FollowIR · Mean over task types · English-0.4#69

FollowIR · Instruction Reranking · English-0.4#69

MTEB Spanish v1 · Mean over tasks · multilingual (2 languages)65.8#12

MTEB Spanish v1 · Mean over task types · multilingual (2 languages)65.8#15

MTEB Spanish v1 · Pair Classification · Spanish68.8#44

MTEB Spanish v1 · STS · multilingual (2 languages)80.1#6

MTEB Spanish v1 · Retrieval · multilingual (2 languages)51.7#12

MTEB Spanish v1 · Clustering · Spanish48.7#21

MTEB Spanish v1 · Reranking · Spanish53.1#46

MTEB Spanish v1 · Classification · Spanish92.4#7

MTEB Thai v1 · Mean over tasks · multilingual (2 languages)62.5#14

MTEB Thai v1 · Mean over task types · multilingual (2 languages)62.3#14

MTEB Thai v1 · Clustering · Thai56#24

MTEB Thai v1 · Classification · Thai66.3#14

MTEB Thai v1 · Pair Classification · Thai78.2#27

MTEB Thai v1 · Retrieval · multilingual (2 languages)63.3#13

MTEB Thai v1 · Reranking · Thai47.9#22

MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)61.6#13

MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)63#9

MTEB Scandinavian v1 · Clustering · multilingual (2 languages)49.8#8

MTEB Scandinavian v1 · Classification · multilingual (6 languages)63.9#22

MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)63.9#28

MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)74.5#21

VN-MTEB Vietnamese v1 · Classification · Vietnamese66.4#14

VN-MTEB Vietnamese v1 · STS · Vietnamese82.9#3

VN-MTEB Vietnamese v1 · Retrieval · Vietnamese40.9#7

VN-MTEB Vietnamese v1 · Clustering · Vietnamese51.5#7

VN-MTEB Vietnamese v1 · Reranking · Vietnamese66.4#7

MTEB Russian v1.1 · Mean over tasks · Russian62.4#22

MTEB Russian v1.1 · Mean over task types · Russian60.5#22

MTEB Russian v1.1 · Classification · Russian66.3#26

MTEB Russian v1.1 · STS · Russian76.5#4

MTEB Russian v1.1 · Reranking · Russian64.3#35

MTEB Russian v1.1 · Clustering · Russian63.1#18

MTEB Russian v1.1 · Pair Classification · Russian63.9#24

MTEB Russian v1.1 · Retrieval · Russian48.4#42

MTEB Russian v1.1 · Multilabel Classification · Russian41.1#23

RTEB Finnish beta · Mean over tasks · English58.6#43

RTEB French beta · Mean over tasks · multilingual (2 languages)40.6#70

RTEB German beta · Mean over tasks · German51.2#59

RTEB Health beta · Mean over tasks · multilingual (4 languages)49#49

RTEB Law beta · Mean over tasks · multilingual (4 languages)45.6#62

MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)63.2#25

MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)55.1#24

MTEB multilingual v2 · Classification · multilingual (119 languages)64.9#26

MTEB multilingual v2 · Clustering · multilingual (208 languages)50.7#34

MTEB multilingual v2 · STS · multilingual (35 languages)76.8#15

MTEB multilingual v2 · Pair Classification · multilingual (24 languages)80.8#28

MTEB multilingual v2 · Retrieval · multilingual (120 languages)57.1#57

MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)80.1#9

MTEB multilingual v2 · Instruction Reranking · English-0.4#69

MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)23#40

MTEB multilingual v2 · Reranking · multilingual (22 languages)62.6#47

FAQ

How much does Multilingual E5 Large Instruct cost?›

$0.01 per 1M tokens.

Is Multilingual E5 Large Instruct free to use?›

There is no free API; the cheapest paid price is $0.01 per 1M input tokens. The weights are open, so you can run it yourself.

How good is Multilingual E5 Large Instruct, and what is it best at?›

#75 of 200 in Embeddings.

Is Multilingual E5 Large Instruct better than Jina Embeddings v5 Text Nano?›

On MTEB Spanish v1 · STS · multilingual (2 languages), Multilingual E5 Large Instruct scores 80.1 vs 81.7 — lower. It is 50% cheaper.

How can I use Multilingual E5 Large Instruct?›

Through the intfloat API.

When was Multilingual E5 Large Instruct released? Is there a newer version?›

Released 2024-02-08. It is the current version in its line.

Is Multilingual E5 Large Instruct open source?›

Yes, the weights are open (MIT licence).

Can I run Multilingual E5 Large Instruct locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Multilingual E5 Large Instruct?›

Multilingual E5 Large Instruct is an open-weights embeddings & retrieval model from intfloat, released Feb 2024.

What are the best alternatives to Multilingual E5 Large Instruct?›

Jina Embeddings v5 Text Small (better).