i

Multilingual E5 Large Instruct

Feb 2024
iMultilingual E5 Large Instruct
Compare in
on
$0.01per 1M tokens
53.5MTEB English v2
Feb 2024released
1,024Dimensions
1K tokensMax input
en, Esperanto, es +90Languages

Rankingconfiguration unstated?

Full ranking →
1F2LLM 4B71.12F2LLM 1.7B60.33F2LLM v2 14B57.64F2LLM v2 8B55.95F2LLM v2 4B55.5
···
63Embedder 100p38.164Multilingual E5 Large Instruct37.965Jina Embeddings v337.7

Strong at

B
Embeddings & Retrieval#75 of 200

Alternatives?

ModelScoreCostPriceWhat changes
CheaperEmbeddingGemma 300MunstatedOpen+13%-80%$0.002Languages: not verifiedcOpenF2LLM 4Bunstated+88%——Languages: loses Esperanto, es, Estonian +89+1sCheaperAll Mpnet Base v2unstatedOpensame-50%$0.005Max input: 1K tokens → 0K tokens+1sCheaperAll MiniLM L12 v2unstatedOpen-3%-50%$0.005Max input: 1K tokens → 0K tokens+1sCheaperAll MiniLM L6 v2unstatedOpen-4%-50%$0.005Max input: 1K tokens → 0K tokens+1

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English52.7#70
BEIR · Mean over task types · English52.7#70
BEIR · Retrieval · English52.7#70
BEIR-NL · Mean over tasks · Dutch44.4#6
BEIR-NL · Mean over task types · Dutch44.4#6
BEIR-NL · Retrieval · Dutch44.4#6
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese64.9#58
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese60.7#56
MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese70.8#25
MTEB Persian v2 · Reranking · Persian72.4#9
JMTEB v2 · Clustering · Japanese54.4#13
JMTEB v2 · STS · Japanese82.9#21
LongEmbed · Mean over tasks · English41.8#64
LongEmbed · Mean over task types · English41.8#64
LongEmbed · Retrieval · English41.8#64
MTEB German v1 · Mean over tasks · German57.1#11
MTEB German v1 · Mean over task types · German55.8#11
MTEB German v1 · Clustering · German40.2#10
MTEB German v1 · Retrieval · German51.9#18
MTEB German v1 · Classification · German69.5#25
MTEB German v1 · STS · German73.7#9
MTEB German v1 · Pair Classification · German53.1#42
MTEB German v1 · Reranking · German46.6#40
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)62.2#10
MTEB Europe v1 · Mean over task types · multilingual (29 languages)55.3#10
MTEB Europe v1 · Retrieval · multilingual (25 languages)54.8#26
MTEB Europe v1 · STS · multilingual (8 languages)77.4#2
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)90.4#15
MTEB Europe v1 · Classification · multilingual (23 languages)63.2#10
MTEB Europe v1 · Clustering · multilingual (29 languages)46.9#31
MTEB Europe v1 · Instruction Reranking · English-0.4#69
MTEB Europe v1 · Pair Classification · multilingual (11 languages)89.9#11
MTEB Europe v1 · Reranking · multilingual (12 languages)58.4#47
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)17.3#45
MTEB French v1 · Mean over tasks · multilingual (2 languages)64.6#12
MTEB French v1 · Mean over task types · multilingual (2 languages)63.2#12
MTEB French v1 · STS · French83#7
MTEB French v1 · Retrieval · multilingual (2 languages)60.5#15
MTEB French v1 · Reranking · French82.3#17
MTEB French v1 · Clustering · French56.1#9
MTEB French v1 · Classification · French69.4#22
MTEB French v1 · Summarization · French31.7#14
MTEB French v1 · Pair Classification · French59.4#76
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)70.2#7
MTEB Indic v1 · Mean over task types · multilingual (25 languages)71.6#7
MTEB Indic v1 · Classification · multilingual (8 languages)67#10
MTEB Indic v1 · Retrieval · multilingual (14 languages)84.9#10
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)80.4#1
MTEB Indic v1 · Reranking · multilingual (2 languages)87.5#16
MTEB Indic v1 · Pair Classification · Hindi76.3#32
MTEB Indic v1 · STS · multilingual (13 languages)53.7#16
MTEB Indic v1 · Clustering · multilingual (21 languages)51.7#15
MTEB Korean v2 · STS · Korean85.2#8
MTEB Korean v2 · Reranking · Korean52.3#42
MTEB Korean v2 · Classification · Korean62.2#15
MTEB Dutch v1 · Mean over tasks · Dutch58.4#20
MTEB Dutch v1 · Mean over task types · Dutch65.5#15
MTEB Dutch v1 · Classification · Dutch64.7#21
MTEB Dutch v1 · Clustering · Dutch45.4#14
MTEB Dutch v1 · Retrieval · Dutch55.1#46
MTEB Dutch v1 · STS · Dutch82.3#15
MTEB Dutch v1 · Multilabel Classification · Dutch38.6#20
MTEB Dutch v1 · Pair Classification · Dutch81.5#8
MTEB Dutch v1 · Reranking · Dutch91.1#22
MTEB Polish v1 · Pair Classification · Polish87.2#7
MTEB Polish v1 · Classification · Polish67#17
MTEB Polish v1 · STS · Polish70.3#8
MTEB Portuguese v1 · Mean over tasks · Portuguese72.2#2
MTEB Portuguese v1 · Mean over task types · Portuguese65.7#3
MTEB Portuguese v1 · Classification · Portuguese64.6#4
MTEB Portuguese v1 · Retrieval · Portuguese75.8#6
MTEB Portuguese v1 · Multilabel Classification · Portuguese20.1#75
MTEB Portuguese v1 · STS · Portuguese82.3#6
MTEB Portuguese v1 · Reranking · Portuguese85.9#1
MTEB Law v1 · Mean over tasks · multilingual (3 languages)54.9#37
MTEB Law v1 · Mean over task types · multilingual (3 languages)54.9#37
MTEB Law v1 · Retrieval · multilingual (3 languages)54.9#37
MTEB Medical v1 · Clustering · English37.9#64
MTEB Medical v1 · Reranking · Mandarin Chinese76#66
FollowIR · Mean over tasks · English-0.4#69
FollowIR · Mean over task types · English-0.4#69
FollowIR · Instruction Reranking · English-0.4#69
MTEB Spanish v1 · Mean over tasks · multilingual (2 languages)65.8#12
MTEB Spanish v1 · Mean over task types · multilingual (2 languages)65.8#15
MTEB Spanish v1 · Pair Classification · Spanish68.8#44
MTEB Spanish v1 · STS · multilingual (2 languages)80.1#6
MTEB Spanish v1 · Retrieval · multilingual (2 languages)51.7#12
MTEB Spanish v1 · Clustering · Spanish48.7#21
MTEB Spanish v1 · Reranking · Spanish53.1#46
MTEB Spanish v1 · Classification · Spanish92.4#7
MTEB Thai v1 · Mean over tasks · multilingual (2 languages)62.5#14
MTEB Thai v1 · Mean over task types · multilingual (2 languages)62.3#14
MTEB Thai v1 · Clustering · Thai56#24
MTEB Thai v1 · Classification · Thai66.3#14
MTEB Thai v1 · Pair Classification · Thai78.2#27
MTEB Thai v1 · Retrieval · multilingual (2 languages)63.3#13
MTEB Thai v1 · Reranking · Thai47.9#22
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)61.6#13
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)63#9
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)49.8#8
MTEB Scandinavian v1 · Classification · multilingual (6 languages)63.9#22
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)63.9#28
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)74.5#21
VN-MTEB Vietnamese v1 · Classification · Vietnamese66.4#14
VN-MTEB Vietnamese v1 · STS · Vietnamese82.9#3
VN-MTEB Vietnamese v1 · Retrieval · Vietnamese40.9#7
VN-MTEB Vietnamese v1 · Clustering · Vietnamese51.5#7
VN-MTEB Vietnamese v1 · Reranking · Vietnamese66.4#7
MTEB Russian v1.1 · Mean over tasks · Russian62.4#22
MTEB Russian v1.1 · Mean over task types · Russian60.5#22
MTEB Russian v1.1 · Classification · Russian66.3#26
MTEB Russian v1.1 · STS · Russian76.5#4
MTEB Russian v1.1 · Reranking · Russian64.3#35
MTEB Russian v1.1 · Clustering · Russian63.1#18
MTEB Russian v1.1 · Pair Classification · Russian63.9#24
MTEB Russian v1.1 · Retrieval · Russian48.4#42
MTEB Russian v1.1 · Multilabel Classification · Russian41.1#23
RTEB Finnish beta · Mean over tasks · English58.6#43
RTEB French beta · Mean over tasks · multilingual (2 languages)40.6#70
RTEB German beta · Mean over tasks · German51.2#59
RTEB Health beta · Mean over tasks · multilingual (4 languages)49#49
RTEB Law beta · Mean over tasks · multilingual (4 languages)45.6#62
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)63.2#25
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)55.1#24
MTEB multilingual v2 · Classification · multilingual (119 languages)64.9#26
MTEB multilingual v2 · Clustering · multilingual (208 languages)50.7#34
MTEB multilingual v2 · STS · multilingual (35 languages)76.8#15
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)80.8#28
MTEB multilingual v2 · Retrieval · multilingual (120 languages)57.1#57
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)80.1#9
MTEB multilingual v2 · Instruction Reranking · English-0.4#69
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)23#40
MTEB multilingual v2 · Reranking · multilingual (22 languages)62.6#47

FAQ

How much does Multilingual E5 Large Instruct cost?›

$0.01 per 1M tokens.

Is Multilingual E5 Large Instruct free to use?›

There is no free API; the cheapest paid price is $0.01 per 1M input tokens. The weights are open, so you can run it yourself.

How good is Multilingual E5 Large Instruct, and what is it best at?›

#75 of 200 in Embeddings.

Is Multilingual E5 Large Instruct better than Embedder 100p?›

On MTEB Medical v1 · Clustering · English, Multilingual E5 Large Instruct scores 37.9 vs 38.1 — about the same.

How can I use Multilingual E5 Large Instruct?›

Through the intfloat API.

When was Multilingual E5 Large Instruct released? Is there a newer version?›

Released 2024-02-08. It is the current version in its line.

Is Multilingual E5 Large Instruct open source?›

Yes, the weights are open (MIT licence).

Can I run Multilingual E5 Large Instruct locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Multilingual E5 Large Instruct?›

Multilingual E5 Large Instruct is an open-weights embeddings & retrieval model from intfloat, released Feb 2024.

What are the best alternatives to Multilingual E5 Large Instruct?›

EmbeddingGemma 300M (cheaper), F2LLM 4B (open weights).