s

Paraphrase Multilingual Mpnet Base v2

Nov 2019
sParaphrase Multilingual Mpnet Base v2
Compare in
on
API price not publicprice
37.1MTEB English v2
Nov 2019released
768Dimensions
0K tokensMax input
en, es, Estonian +45Languages

Rankingconfiguration unstated?

Full ranking →
1Octen Law 8B v176.82Litil Embed 0.6B73.33Dinghy Law 8B v172.64Dinghy Law 4B v171.25Euler Legal Embedding v170.4
···
110LLM2Vec Mistral 7B Instruct v2 Mntp Supervised36.5111Paraphrase Multilingual Mpnet Base v236.4112Gte Micro v436.3

Strong at

C
Embeddings & Retrieval#152 of 200

Alternatives?

ModelScoreCostPriceWhat changes
BetterBge Base En v1.5unstatedOpen+11%—$0.005Languages: loses es, Estonian, fr +44lOpenOcten Law 8B v1×2.1——Languages: loses es, Estonian, fr +43+1tBetterGte BaseunstatedOpen+10%—$0.005Languages: loses es, Estonian, fr +44iBetterE5 Base v2unstatedOpen+9%—$0.005Languages: loses es, Estonian, fr +44iBetterMultilingual E5 Large InstructunstatedOpen+51%—$0.01Memory (4-bit): 0.2 GB → 0.3 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English35.3#157
BEIR · Mean over task types · English35.3#157
BEIR · Retrieval · English35.3#157
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese22.9#81
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese44.9#70
MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese66.1#33
MTEB Persian v2 · Reranking · Persian60.1#47
JMTEB v2 · Clustering · Japanese42.4#61
JMTEB v2 · STS · Japanese72.1#71
LongEmbed · Mean over tasks · English21.7#147
LongEmbed · Mean over task types · English21.7#147
LongEmbed · Retrieval · English21.7#147
MTEB German v1 · Mean over tasks · German48.6#28
MTEB German v1 · Mean over task types · German48.1#28
MTEB German v1 · Clustering · German26#71
MTEB German v1 · Retrieval · German39.7#48
MTEB German v1 · Classification · German64#47
MTEB German v1 · STS · German65.5#42
MTEB German v1 · Pair Classification · German52.4#55
MTEB German v1 · Reranking · German40.7#50
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)54.4#23
MTEB Europe v1 · Mean over task types · multilingual (29 languages)48.5#24
MTEB Europe v1 · Retrieval · multilingual (25 languages)41.2#72
MTEB Europe v1 · STS · multilingual (8 languages)74.3#17
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)79.5#82
MTEB Europe v1 · Classification · multilingual (23 languages)56.6#40
MTEB Europe v1 · Clustering · multilingual (29 languages)35.8#102
MTEB Europe v1 · Instruction Reranking · English-1.1#90
MTEB Europe v1 · Pair Classification · multilingual (11 languages)90.7#5
MTEB Europe v1 · Reranking · multilingual (12 languages)52.3#85
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)6.9#147
MTEB French v1 · Mean over tasks · multilingual (2 languages)54.4#26
MTEB French v1 · Mean over task types · multilingual (2 languages)55.5#25
MTEB French v1 · STS · French78.4#20
MTEB French v1 · Retrieval · multilingual (2 languages)43#48
MTEB French v1 · Reranking · French74.1#46
MTEB French v1 · Clustering · French40.5#62
MTEB French v1 · Classification · French65#39
MTEB French v1 · Summarization · French29.5#109
MTEB French v1 · Pair Classification · French58#94
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)58.5#38
MTEB Indic v1 · Mean over task types · multilingual (25 languages)55.2#38
MTEB Indic v1 · Classification · multilingual (8 languages)62#30
MTEB Indic v1 · Retrieval · multilingual (14 languages)57.9#56
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)44.2#48
MTEB Indic v1 · Reranking · multilingual (2 languages)74.3#89
MTEB Indic v1 · Pair Classification · Hindi82#10
MTEB Indic v1 · STS · multilingual (13 languages)34.1#62
MTEB Indic v1 · Clustering · multilingual (21 languages)32.1#64
MTEB Korean v2 · STS · Korean81.8#21
MTEB Korean v2 · Reranking · Korean40.1#53
MTEB Korean v2 · Classification · Korean49.1#50
MTEB Dutch v1 · Mean over tasks · Dutch49#58
MTEB Dutch v1 · Mean over task types · Dutch58.4#48
MTEB Dutch v1 · Classification · Dutch58.7#48
MTEB Dutch v1 · Clustering · Dutch31.7#48
MTEB Dutch v1 · Retrieval · Dutch41.4#67
MTEB Dutch v1 · STS · Dutch80#26
MTEB Dutch v1 · Multilabel Classification · Dutch32.6#62
MTEB Dutch v1 · Pair Classification · Dutch82#7
MTEB Dutch v1 · Reranking · Dutch82.3#99
MTEB Polish v1 · Pair Classification · Polish86.2#12
MTEB Polish v1 · Classification · Polish54.1#52
MTEB Polish v1 · STS · Polish65.2#40
MTEB Portuguese v1 · Mean over tasks · Portuguese64.6#14
MTEB Portuguese v1 · Mean over task types · Portuguese58.4#15
MTEB Portuguese v1 · Classification · Portuguese58.8#10
MTEB Portuguese v1 · Retrieval · Portuguese58#13
MTEB Portuguese v1 · Multilabel Classification · Portuguese15.2#184
MTEB Portuguese v1 · STS · Portuguese78.7#11
MTEB Portuguese v1 · Reranking · Portuguese81.1#16
MTEB Law v1 · Mean over tasks · multilingual (3 languages)36.4#111
MTEB Law v1 · Mean over task types · multilingual (3 languages)36.4#111
MTEB Law v1 · Retrieval · multilingual (3 languages)36.4#111
MTEB Medical v1 · Clustering · English36#99
MTEB Medical v1 · Reranking · Mandarin Chinese50.4#96
FollowIR · Mean over tasks · English-1.1#90
FollowIR · Mean over task types · English-1.1#90
FollowIR · Instruction Reranking · English-1.1#90
MTEB Spanish v1 · Mean over tasks · multilingual (2 languages)58.2#22
MTEB Spanish v1 · Mean over task types · multilingual (2 languages)59.9#22
MTEB Spanish v1 · Pair Classification · Spanish71#27
MTEB Spanish v1 · STS · multilingual (2 languages)75.9#28
MTEB Spanish v1 · Retrieval · multilingual (2 languages)37.5#23
MTEB Spanish v1 · Clustering · Spanish37.1#95
MTEB Spanish v1 · Reranking · Spanish51#50
MTEB Spanish v1 · Classification · Spanish86.6#15
MTEB Thai v1 · Clustering · Thai43#58
MTEB Thai v1 · Pair Classification · Thai83.8#10
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)51.2#35
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)49.3#36
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)35.7#68
MTEB Scandinavian v1 · Classification · multilingual (6 languages)58.5#46
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)50.4#39
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)52.7#176
MTEB Russian v1.1 · Mean over tasks · Russian53.2#41
MTEB Russian v1.1 · Mean over task types · Russian52.1#41
MTEB Russian v1.1 · Classification · Russian57#60
MTEB Russian v1.1 · STS · Russian69#54
MTEB Russian v1.1 · Reranking · Russian51.2#62
MTEB Russian v1.1 · Clustering · Russian49.2#69
MTEB Russian v1.1 · Pair Classification · Russian64.6#21
MTEB Russian v1.1 · Retrieval · Russian40.7#44
MTEB Russian v1.1 · Multilabel Classification · Russian32.9#56
RTEB Finnish beta · Mean over tasks · English36.2#80
RTEB French beta · Mean over tasks · multilingual (2 languages)27.2#103
RTEB German beta · Mean over tasks · German17.8#129
RTEB Health beta · Mean over tasks · multilingual (4 languages)30.6#77
RTEB Law beta · Mean over tasks · multilingual (4 languages)28.6#156
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)51.9#54
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)45#55
MTEB multilingual v2 · Classification · multilingual (119 languages)55.1#63
MTEB multilingual v2 · Clustering · multilingual (208 languages)40.2#97
MTEB multilingual v2 · STS · multilingual (35 languages)69.7#56
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)81.2#23
MTEB multilingual v2 · Retrieval · multilingual (120 languages)39.8#95
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)52.1#80
MTEB multilingual v2 · Instruction Reranking · English-1.1#90
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)15#139
MTEB multilingual v2 · Reranking · multilingual (22 languages)53.4#79

FAQ

How much does Paraphrase Multilingual Mpnet Base v2 cost?›

There is no per-unit API price: API price not public.

Is Paraphrase Multilingual Mpnet Base v2 free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Paraphrase Multilingual Mpnet Base v2, and what is it best at?›

#152 of 200 in Embeddings.

Is Paraphrase Multilingual Mpnet Base v2 better than LLM2Vec Mistral 7B Instruct v2 Mntp Supervised?›

On MTEB Law v1 · Mean over task types · multilingual (3 languages), Paraphrase Multilingual Mpnet Base v2 scores 36.4 vs 36.5 — about the same.

When was Paraphrase Multilingual Mpnet Base v2 released? Is there a newer version?›

Released 2019-11-01. It is the current version in its line.

Is Paraphrase Multilingual Mpnet Base v2 open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Paraphrase Multilingual Mpnet Base v2 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Paraphrase Multilingual Mpnet Base v2?›

Paraphrase Multilingual Mpnet Base v2 is an open-weights embeddings & retrieval model from sentence-transformers, released Nov 2019.

What are the best alternatives to Paraphrase Multilingual Mpnet Base v2?›

Bge Base En v1.5 (better), Octen Law 8B v1 (open weights).