s

Mmlw E5 Large

Nov 2023
sMmlw E5 Large
Compare in
on
self-host onlyprice
41.4MTEB English v2
Nov 2023released
1,024Dimensions
1K tokensMax input
PolishLanguages

Rankingconfiguration unstated?

Full ranking →
1Gte Qwen2 7B Instruct66.62F2LLM v2 14B65.23Gte Qwen2 1.5B Instruct654F2LLM v2 8B64.95F2LLM v2 4B64.5
···
55B1ade Embed41.256Mmlw E5 Large4157Nomic Embed Text v1 Unsupervised40.9

Strong at

C
Embeddings & Retrieval#143 of 200

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English37#153
BEIR · Mean over task types · English37#153
BEIR · Retrieval · English37#153
MTEB Persian v2 · Reranking · Persian33.4#97
JMTEB v2 · Clustering · Japanese25.6#78
JMTEB v2 · STS · Japanese52.5#134
LongEmbed · Mean over tasks · English40.2#73
LongEmbed · Mean over task types · English40.2#73
LongEmbed · Retrieval · English40.2#73
MTEB German v1 · Mean over tasks · German42.4#48
MTEB German v1 · Mean over task types · German40.3#49
MTEB German v1 · Clustering · German29.4#48
MTEB German v1 · Retrieval · German36.6#61
MTEB German v1 · Classification · German52.5#79
MTEB German v1 · STS · German53.6#64
MTEB German v1 · Pair Classification · German49.6#98
MTEB German v1 · Reranking · German20.2#105
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)48.9#39
MTEB Europe v1 · Mean over task types · multilingual (29 languages)43#40
MTEB Europe v1 · Retrieval · multilingual (25 languages)39.2#80
MTEB Europe v1 · STS · multilingual (8 languages)70.3#31
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)42.7#104
MTEB Europe v1 · Classification · multilingual (23 languages)53.6#49
MTEB Europe v1 · Clustering · multilingual (29 languages)38.6#71
MTEB Europe v1 · Instruction Reranking · English-3.4#180
MTEB Europe v1 · Pair Classification · multilingual (11 languages)84.9#54
MTEB Europe v1 · Reranking · multilingual (12 languages)48.3#127
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)12.3#103
MTEB French v1 · Mean over tasks · multilingual (2 languages)52.6#31
MTEB French v1 · Mean over task types · multilingual (2 languages)52.8#37
MTEB French v1 · STS · French71.9#51
MTEB French v1 · Retrieval · multilingual (2 languages)35.9#76
MTEB French v1 · Reranking · French67.4#77
MTEB French v1 · Clustering · French47.2#18
MTEB French v1 · Classification · French61.4#51
MTEB French v1 · Summarization · French31.2#28
MTEB French v1 · Pair Classification · French54.3#157
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)36.6#61
MTEB Indic v1 · Mean over task types · multilingual (25 languages)25.7#66
MTEB Indic v1 · Classification · multilingual (8 languages)48.2#60
MTEB Indic v1 · Retrieval · multilingual (14 languages)13.7#102
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)7.7#69
MTEB Indic v1 · Reranking · multilingual (2 languages)47.9#134
MTEB Indic v1 · Pair Classification · Hindi53.2#138
MTEB Indic v1 · STS · multilingual (13 languages)4.7#129
MTEB Indic v1 · Clustering · multilingual (21 languages)4.3#112
MTEB Korean v2 · STS · Korean38.7#62
MTEB Korean v2 · Reranking · Korean5.6#131
MTEB Korean v2 · Classification · Korean26.5#68
MTEB Dutch v1 · Mean over tasks · Dutch39.7#86
MTEB Dutch v1 · Mean over task types · Dutch47.5#84
MTEB Dutch v1 · Classification · Dutch51.2#71
MTEB Dutch v1 · Clustering · Dutch26.5#67
MTEB Dutch v1 · Retrieval · Dutch29.4#98
MTEB Dutch v1 · STS · Dutch58.8#94
MTEB Dutch v1 · Multilabel Classification · Dutch32.2#65
MTEB Dutch v1 · Pair Classification · Dutch59.5#104
MTEB Dutch v1 · Reranking · Dutch75.2#155
MTEB Polish v1 · Pair Classification · Polish82.7#36
MTEB Polish v1 · Classification · Polish56.8#43
MTEB Polish v1 · STS · Polish64.2#42
MTEB Portuguese v1 · Multilabel Classification · Portuguese20#78
MTEB Law v1 · Mean over tasks · multilingual (3 languages)39.3#92
MTEB Law v1 · Mean over task types · multilingual (3 languages)39.3#92
MTEB Law v1 · Retrieval · multilingual (3 languages)39.3#92
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)41#56
MTEB Medical v1 · Mean over task types · multilingual (10 languages)32.8#78
MTEB Medical v1 · Retrieval · multilingual (10 languages)44.6#58
MTEB Medical v1 · Clustering · English37.2#69
MTEB Medical v1 · Reranking · Mandarin Chinese16.6#157
FollowIR · Mean over tasks · English-3.4#180
FollowIR · Mean over task types · English-3.4#180
FollowIR · Instruction Reranking · English-3.4#180
MTEB Spanish v1 · Pair Classification · Spanish60.4#99
MTEB Spanish v1 · STS · multilingual (2 languages)66.8#48
MTEB Spanish v1 · Clustering · Spanish44.5#44
MTEB Spanish v1 · Reranking · Spanish28.9#97
MTEB Thai v1 · Clustering · Thai5.1#112
MTEB Thai v1 · Pair Classification · Thai51.7#136
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)38.2#57
MTEB Scandinavian v1 · Classification · multilingual (6 languages)49.7#80
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)58.6#147
MTEB Russian v1.1 · Classification · Russian34.7#94
MTEB Russian v1.1 · STS · Russian43.2#96
MTEB Russian v1.1 · Reranking · Russian14.4#137
MTEB Russian v1.1 · Clustering · Russian19.7#101
MTEB Russian v1.1 · Pair Classification · Russian49.6#136
MTEB Russian v1.1 · Multilabel Classification · Russian26.9#97
RTEB French beta · Mean over tasks · multilingual (2 languages)9.9#163
RTEB German beta · Mean over tasks · German16.8#132
RTEB Law beta · Mean over tasks · multilingual (4 languages)30.9#139
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)45.4#67
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)38#70
MTEB multilingual v2 · Classification · multilingual (119 languages)52.1#76
MTEB multilingual v2 · Clustering · multilingual (208 languages)42.9#59
MTEB multilingual v2 · STS · multilingual (35 languages)59.5#82
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)73.4#94
MTEB multilingual v2 · Retrieval · multilingual (120 languages)33.3#133
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)26.9#109
MTEB multilingual v2 · Instruction Reranking · English-3.4#180
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)17.1#92
MTEB multilingual v2 · Reranking · multilingual (22 languages)39.8#138

FAQ

How much does Mmlw E5 Large cost?›

There is no per-unit API price: self-host only.

Is Mmlw E5 Large free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Mmlw E5 Large, and what is it best at?›

#143 of 200 in Embeddings.

Is Mmlw E5 Large better than B1ade Embed?›

On MTEB Medical v1 · Mean over tasks · multilingual (10 languages), Mmlw E5 Large scores 41 vs 41.2 — about the same.

When was Mmlw E5 Large released? Is there a newer version?›

Released 2023-11-17. It is the current version in its line.

Is Mmlw E5 Large open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Mmlw E5 Large locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Mmlw E5 Large?›

Mmlw E5 Large is an open-weights embeddings & retrieval model from sdadas, released Nov 2023.

What are the best alternatives to Mmlw E5 Large?›

Text Embedding 3 Small (better), Gte Qwen2 7B Instruct (open weights).