s

Mmlw E5 Small

Nov 2023
sMmlw E5 Small
Compare in
on
self-host onlyprice
36.4MTEB English v2
Nov 2023released
384Dimensions
1K tokensMax input
PolishLanguages

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B78.82FlowVec v1783F2LLM v2 8B77.94F2LLM v2 4B76.65F2LLM v2 1.7B74.2
···
66Nomic Embed Text v136.267Mmlw E5 Small36.268Nomic Embed Text v1.535.6

Strong at

C
Embeddings & Retrieval#154 of 200

Alternatives?

ModelScoreCostPriceWhat changes
iBetterMultilingual E5 Large InstructunstatedOpen+94%—$0.01Memory (4-bit): 0.1 GB → 0.3 GBLOpenFlowVec v1×2.2——Memory (4-bit): 0.1 GB → 4.5 GBVBetterVoyage 3 Liteunstated+75%—$0.02Languages: not verifiediBetterE5 Mistral 7B InstructunstatedOpen+66%—$0.022Memory (4-bit): 0.1 GB → 4.3 GBcBetterF2LLM v2 14BunstatedOpen×2.2——Memory (4-bit): 0.1 GB → 8.4 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English33.5#161
BEIR · Mean over task types · English33.5#161
BEIR · Retrieval · English33.5#161
MTEB Persian v2 · Reranking · Persian22.2#128
JMTEB v2 · Clustering · Japanese16.1#113
JMTEB v2 · STS · Japanese43.3#143
LongEmbed · Mean over tasks · English32.8#113
LongEmbed · Mean over task types · English32.8#113
LongEmbed · Retrieval · English32.8#113
MTEB German v1 · Mean over tasks · German35.6#78
MTEB German v1 · Mean over task types · German33.8#81
MTEB German v1 · Clustering · German25.6#73
MTEB German v1 · Retrieval · German24.3#89
MTEB German v1 · Classification · German46.5#126
MTEB German v1 · STS · German42.6#108
MTEB German v1 · Pair Classification · German48.6#148
MTEB German v1 · Reranking · German15#123
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)45.6#48
MTEB Europe v1 · Mean over task types · multilingual (29 languages)39.6#48
MTEB Europe v1 · Retrieval · multilingual (25 languages)35.1#100
MTEB Europe v1 · STS · multilingual (8 languages)67.9#44
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)30.5#144
MTEB Europe v1 · Classification · multilingual (23 languages)52.2#59
MTEB Europe v1 · Clustering · multilingual (29 languages)36.6#90
MTEB Europe v1 · Instruction Reranking · English-4.4#197
MTEB Europe v1 · Pair Classification · multilingual (11 languages)83.8#74
MTEB Europe v1 · Reranking · multilingual (12 languages)43.1#142
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)11.7#109
MTEB French v1 · Mean over tasks · multilingual (2 languages)45.8#69
MTEB French v1 · Mean over task types · multilingual (2 languages)46.3#74
MTEB French v1 · STS · French64.2#82
MTEB French v1 · Retrieval · multilingual (2 languages)24.5#104
MTEB French v1 · Reranking · French54#107
MTEB French v1 · Clustering · French45.6#26
MTEB French v1 · Classification · French53.4#81
MTEB French v1 · Summarization · French30.2#76
MTEB French v1 · Pair Classification · French52.4#171
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)36.2#67
MTEB Indic v1 · Mean over task types · multilingual (25 languages)23.8#83
MTEB Indic v1 · Classification · multilingual (8 languages)49#59
MTEB Indic v1 · Retrieval · multilingual (14 languages)10#123
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)9.1#66
MTEB Indic v1 · Reranking · multilingual (2 languages)38.4#160
MTEB Indic v1 · Pair Classification · Hindi52.1#158
MTEB Indic v1 · STS · multilingual (13 languages)3.3#139
MTEB Indic v1 · Clustering · multilingual (21 languages)4.7#109
MTEB Korean v2 · STS · Korean23.3#74
MTEB Korean v2 · Reranking · Korean5#139
MTEB Korean v2 · Classification · Korean29.8#63
MTEB Dutch v1 · Mean over tasks · Dutch34.5#105
MTEB Dutch v1 · Mean over task types · Dutch42.6#110
MTEB Dutch v1 · Classification · Dutch47.8#86
MTEB Dutch v1 · Clustering · Dutch22.8#86
MTEB Dutch v1 · Retrieval · Dutch21.1#113
MTEB Dutch v1 · STS · Dutch49.4#125
MTEB Dutch v1 · Multilabel Classification · Dutch28.7#100
MTEB Dutch v1 · Pair Classification · Dutch58.2#125
MTEB Dutch v1 · Reranking · Dutch70#176
MTEB Polish v1 · Pair Classification · Polish85.1#23
MTEB Polish v1 · Classification · Polish58.2#37
MTEB Polish v1 · STS · Polish68.3#19
MTEB Portuguese v1 · Multilabel Classification · Portuguese20.4#68
MTEB Law v1 · Mean over tasks · multilingual (3 languages)35.7#118
MTEB Law v1 · Mean over task types · multilingual (3 languages)35.7#118
MTEB Law v1 · Retrieval · multilingual (3 languages)35.7#118
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)35.3#87
MTEB Medical v1 · Mean over task types · multilingual (10 languages)28.6#97
MTEB Medical v1 · Retrieval · multilingual (10 languages)37.8#86
MTEB Medical v1 · Clustering · English36#98
MTEB Medical v1 · Reranking · Mandarin Chinese12#173
FollowIR · Mean over tasks · English-4.4#197
FollowIR · Mean over task types · English-4.4#197
FollowIR · Instruction Reranking · English-4.4#197
MTEB Spanish v1 · Pair Classification · Spanish57.5#131
MTEB Spanish v1 · STS · multilingual (2 languages)59.8#60
MTEB Spanish v1 · Clustering · Spanish41.6#69
MTEB Spanish v1 · Reranking · Spanish21#119
MTEB Thai v1 · Clustering · Thai6.5#110
MTEB Thai v1 · Pair Classification · Thai52.4#117
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)32.9#97
MTEB Scandinavian v1 · Classification · multilingual (6 languages)48.8#90
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)51.7#179
MTEB Russian v1.1 · Mean over tasks · Russian27.5#72
MTEB Russian v1.1 · Mean over task types · Russian25.7#82
MTEB Russian v1.1 · Classification · Russian37.3#90
MTEB Russian v1.1 · STS · Russian32.5#122
MTEB Russian v1.1 · Reranking · Russian10.4#146
MTEB Russian v1.1 · Clustering · Russian25#95
MTEB Russian v1.1 · Pair Classification · Russian48.3#145
MTEB Russian v1.1 · Retrieval · Russian0.6#102
MTEB Russian v1.1 · Multilabel Classification · Russian26#120
RTEB French beta · Mean over tasks · multilingual (2 languages)3.4#187
RTEB German beta · Mean over tasks · German9.2#182
RTEB Law beta · Mean over tasks · multilingual (4 languages)28.2#158
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)43.1#74
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)35.6#76
MTEB multilingual v2 · Classification · multilingual (119 languages)50.7#79
MTEB multilingual v2 · Clustering · multilingual (208 languages)40.9#82
MTEB multilingual v2 · STS · multilingual (35 languages)55.5#93
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)73.7#92
MTEB multilingual v2 · Retrieval · multilingual (120 languages)31#142
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)21.2#144
MTEB multilingual v2 · Instruction Reranking · English-4.4#197
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)16.6#104
MTEB multilingual v2 · Reranking · multilingual (22 languages)34.9#160

FAQ

How much does Mmlw E5 Small cost?›

There is no per-unit API price: self-host only.

Is Mmlw E5 Small free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Mmlw E5 Small, and what is it best at?›

#154 of 200 in Embeddings.

Is Mmlw E5 Small better than Nomic Embed Text v1?›

On MTEB Indic v1 · Mean over tasks · multilingual (25 languages), Mmlw E5 Small scores 36.2 vs 36.2 — about the same.

When was Mmlw E5 Small released? Is there a newer version?›

Released 2023-11-17. It is the current version in its line.

Is Mmlw E5 Small open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Mmlw E5 Small locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Mmlw E5 Small?›

Mmlw E5 Small is an open-weights embeddings & retrieval model from sdadas, released Nov 2023.

What are the best alternatives to Mmlw E5 Small?›

Multilingual E5 Large Instruct (better), FlowVec v1 (open weights).