s

Mmlw Roberta Large

Nov 2023
sMmlw Roberta Large
Compare in
on
API price not publicprice
39.7MTEB English v2
Nov 2023released
1,024Dimensions
1K tokensMax input
PolishLanguages

Rankingconfiguration unstated?

Full ranking →
1LCO Embedding Omni 7B39.72LGAI Embedding Preview38.93Gemini Embedding 00138.34ICT TIME And Querit Embedding v1385Giga Embeddings Instruct37.7
···
28Text Embedding 0053529Mmlw Roberta Large3530UltraBERT Embed 150M34.9

Strong at

C
Embeddings & Retrieval#148 of 200

Alternatives?

ModelScoreCostPriceWhat changes
BetterEmbeddingGemma 300MunstatedOpen+8%—$0.002Languages: not verifiedaOpenLGAI Embedding Previewunstated+11%——Memory (4-bit): 0.3 GB → 4.3 GBBetterGemini Embedding 001unstated+9%—$0.15Languages: not verifiedIBetterICT TIME And Querit Embedding v1unstatedOpen+9%——Languages: not verified+1aBetterGiga Embeddings InstructunstatedOpen+8%——Memory (4-bit): 0.3 GB → 1.9 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English35.8#156
BEIR · Mean over task types · English35.8#156
BEIR · Retrieval · English35.8#156
MTEB Persian v2 · Reranking · Persian18.3#143
JMTEB v2 · Clustering · Japanese15.3#115
JMTEB v2 · STS · Japanese3.9#164
LongEmbed · Mean over tasks · English37.4#90
LongEmbed · Mean over task types · English37.4#90
LongEmbed · Retrieval · English37.4#90
MTEB German v1 · Mean over tasks · German40.5#53
MTEB German v1 · Mean over task types · German38.1#62
MTEB German v1 · Clustering · German26.7#65
MTEB German v1 · Retrieval · German33.2#76
MTEB German v1 · Classification · German52.2#81
MTEB German v1 · STS · German49.3#87
MTEB German v1 · Pair Classification · German49.9#90
MTEB German v1 · Reranking · German17.5#113
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)47.8#41
MTEB Europe v1 · Mean over task types · multilingual (29 languages)41.9#41
MTEB Europe v1 · Retrieval · multilingual (25 languages)37.4#91
MTEB Europe v1 · STS · multilingual (8 languages)69.5#36
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)38.2#121
MTEB Europe v1 · Classification · multilingual (23 languages)53.8#48
MTEB Europe v1 · Clustering · multilingual (29 languages)37#86
MTEB Europe v1 · Instruction Reranking · English-3.6#187
MTEB Europe v1 · Pair Classification · multilingual (11 languages)85#53
MTEB Europe v1 · Reranking · multilingual (12 languages)46.9#132
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)12.7#93
MTEB French v1 · Mean over tasks · multilingual (2 languages)49.5#50
MTEB French v1 · Mean over task types · multilingual (2 languages)50.2#57
MTEB French v1 · STS · French70.5#59
MTEB French v1 · Retrieval · multilingual (2 languages)29.9#98
MTEB French v1 · Reranking · French64#92
MTEB French v1 · Clustering · French45.4#28
MTEB French v1 · Classification · French57.7#61
MTEB French v1 · Summarization · French29.5#105
MTEB French v1 · Pair Classification · French54.1#161
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)32.6#90
MTEB Indic v1 · Mean over task types · multilingual (25 languages)21.9#101
MTEB Indic v1 · Classification · multilingual (8 languages)44.1#81
MTEB Indic v1 · Retrieval · multilingual (14 languages)9.2#128
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)4.9#92
MTEB Indic v1 · Reranking · multilingual (2 languages)33.4#178
MTEB Indic v1 · Pair Classification · Hindi51#167
MTEB Indic v1 · STS · multilingual (13 languages)6.3#121
MTEB Indic v1 · Clustering · multilingual (21 languages)4.1#115
MTEB Korean v2 · STS · Korean5.2#81
MTEB Korean v2 · Reranking · Korean5.5#132
MTEB Korean v2 · Classification · Korean21.6#106
MTEB Dutch v1 · Mean over tasks · Dutch38.5#90
MTEB Dutch v1 · Mean over task types · Dutch46.6#91
MTEB Dutch v1 · Classification · Dutch50.2#76
MTEB Dutch v1 · Clustering · Dutch24.6#76
MTEB Dutch v1 · Retrieval · Dutch28.4#101
MTEB Dutch v1 · STS · Dutch58#96
MTEB Dutch v1 · Multilabel Classification · Dutch30.5#86
MTEB Dutch v1 · Pair Classification · Dutch58.5#119
MTEB Dutch v1 · Reranking · Dutch75.7#150
MTEB Polish v1 · Pair Classification · Polish89.2#3
MTEB Polish v1 · Classification · Polish66.4#18
MTEB Polish v1 · STS · Polish70.6#6
MTEB Portuguese v1 · Multilabel Classification · Portuguese17.5#157
MTEB Law v1 · Mean over tasks · multilingual (3 languages)37.3#108
MTEB Law v1 · Mean over task types · multilingual (3 languages)37.3#108
MTEB Law v1 · Retrieval · multilingual (3 languages)37.3#108
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)39.2#68
MTEB Medical v1 · Mean over task types · multilingual (10 languages)29.7#93
MTEB Medical v1 · Retrieval · multilingual (10 languages)43#67
MTEB Medical v1 · Clustering · English37.3#68
MTEB Medical v1 · Reranking · Mandarin Chinese8.8#192
FollowIR · Mean over tasks · English-3.6#187
FollowIR · Mean over task types · English-3.6#187
FollowIR · Instruction Reranking · English-3.6#187
MTEB Spanish v1 · Pair Classification · Spanish59.8#106
MTEB Spanish v1 · STS · multilingual (2 languages)64.3#52
MTEB Spanish v1 · Clustering · Spanish42.1#65
MTEB Spanish v1 · Reranking · Spanish21.3#118
MTEB Thai v1 · Clustering · Thai3.8#138
MTEB Thai v1 · Pair Classification · Thai51.4#149
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)34.5#82
MTEB Scandinavian v1 · Classification · multilingual (6 languages)48.3#108
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)60.3#140
MTEB Russian v1.1 · Mean over tasks · Russian18.9#101
MTEB Russian v1.1 · Mean over task types · Russian20#103
MTEB Russian v1.1 · Classification · Russian24#139
MTEB Russian v1.1 · STS · Russian16.9#132
MTEB Russian v1.1 · Reranking · Russian8.7#154
MTEB Russian v1.1 · Clustering · Russian15.3#128
MTEB Russian v1.1 · Pair Classification · Russian47.8#154
MTEB Russian v1.1 · Retrieval · Russian1#95
MTEB Russian v1.1 · Multilabel Classification · Russian26.5#105
RTEB French beta · Mean over tasks · multilingual (2 languages)5.3#178
RTEB German beta · Mean over tasks · German13.6#158
RTEB Law beta · Mean over tasks · multilingual (4 languages)28.8#155
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)42.5#75
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)35.7#74
MTEB multilingual v2 · Classification · multilingual (119 languages)48.4#99
MTEB multilingual v2 · Clustering · multilingual (208 languages)41.1#81
MTEB multilingual v2 · STS · multilingual (35 languages)51.9#98
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)73.9#91
MTEB multilingual v2 · Retrieval · multilingual (120 languages)31.7#140
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)25.3#121
MTEB multilingual v2 · Instruction Reranking · English-3.6#187
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)16.8#98
MTEB multilingual v2 · Reranking · multilingual (22 languages)35.9#155

FAQ

How much does Mmlw Roberta Large cost?›

There is no per-unit API price: API price not public.

Is Mmlw Roberta Large free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Mmlw Roberta Large, and what is it best at?›

#148 of 200 in Embeddings.

Is Mmlw Roberta Large better than Text Embedding 005?›

On MTEB English v2 · Summarization · English, Mmlw Roberta Large scores 35 vs 35 — about the same.

When was Mmlw Roberta Large released? Is there a newer version?›

Released 2023-11-17. It is the current version in its line.

Is Mmlw Roberta Large open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Mmlw Roberta Large locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Mmlw Roberta Large?›

Mmlw Roberta Large is an open-weights embeddings & retrieval model from sdadas, released Nov 2023.

What are the best alternatives to Mmlw Roberta Large?›

EmbeddingGemma 300M (better), LGAI Embedding Preview (open weights).