s

All Mpnet Base v2

Aug 2021
sAll Mpnet Base v2
Compare in
on
$0.005per 1M tokens
44.5MTEB English v2
Aug 2021released
768Dimensions
0K tokensMax input
enLanguages

Rankingconfiguration unstated?

Full ranking →
1SearchMap Preview61.62Text Embedding 3 Large59.93Cohere Embed English v355.74F2LLM v2 8B54.55Cohere Embed Multilingual v353.1
···
9Bekko Embedding v1 A25m50.810All Mpnet Base v250.511All MiniLM L12 v249.7

Strong at

C
Embeddings & Retrieval#130 of 200

Alternatives?

ModelScoreCostPriceWhat changes
BetterCohere Embed English v3+10%+1,900%$0.10Languages: not verifiedVOpenSearchMap Previewunstated+22%——Memory (4-bit): 0.1 GB → 0.3 GBBetterText Embedding 3 Largeunstated+19%+2,500%$0.13Languages: not verifiedcBetterF2LLM v2 8BunstatedOpen+8%——Memory (4-bit): 0.1 GB → 4.5 GBBetterCohere Embed Multilingual v3+5%——Languages: not verified

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English43.8#136
BEIR · Mean over task types · English43.8#136
BEIR · Retrieval · English43.8#136
BRIGHT · Mean over tasks · English14.6#17
BRIGHT · Mean over task types · English14.6#17
BRIGHT · Retrieval · English14.6#17
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese4.4#85
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese25.1#77
MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese43.3#40
ChemTEB · Mean over tasks · multilingual (13 languages)69.8#24
ChemTEB · Mean over task types · multilingual (13 languages)49.3#28
ChemTEB · Classification · English82.2#18
ChemTEB · Retrieval · English60.7#44
ChemTEB · Pair Classification · multilingual (13 languages)52.9#41
ChemTEB · Clustering · English50.5#10
ChemTEB · Bitext Mining · English0.1#42
JMTEB v2 · STS · Japanese67.1#75
LongEmbed · Mean over tasks · English31.1#122
LongEmbed · Mean over task types · English31.1#122
LongEmbed · Retrieval · English31.1#122
MTEB German v1 · Mean over tasks · German39#64
MTEB German v1 · Mean over task types · German37.6#65
MTEB German v1 · Clustering · German23.8#93
MTEB German v1 · Retrieval · German34.4#71
MTEB German v1 · Classification · German49.1#99
MTEB German v1 · STS · German45.8#101
MTEB German v1 · Pair Classification · German49#125
MTEB German v1 · Reranking · German23.4#90
MTEB Europe v1 · STS · multilingual (8 languages)63.9#55
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)29.9#145
MTEB Europe v1 · Instruction Reranking · English-3.1#166
MTEB Europe v1 · Pair Classification · multilingual (11 languages)80.5#107
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)10.9#122
MTEB French v1 · Retrieval · multilingual (2 languages)34.8#79
MTEB French v1 · Reranking · French67.9#73
MTEB French v1 · Clustering · French42.3#45
MTEB French v1 · Summarization · French28.1#139
MTEB Indic v1 · Retrieval · multilingual (14 languages)12.9#108
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)3.7#108
MTEB Indic v1 · Pair Classification · Hindi52.6#145
MTEB Indic v1 · STS · multilingual (13 languages)-2.5#186
MTEB Korean v2 · STS · Korean33.7#71
MTEB Korean v2 · Reranking · Korean5.9#128
MTEB Korean v2 · Classification · Korean23.2#77
MTEB Dutch v1 · Mean over tasks · Dutch36.6#97
MTEB Dutch v1 · Mean over task types · Dutch44.8#99
MTEB Dutch v1 · Classification · Dutch46#96
MTEB Dutch v1 · Clustering · Dutch21.6#93
MTEB Dutch v1 · Retrieval · Dutch29.2#99
MTEB Dutch v1 · STS · Dutch57#103
MTEB Dutch v1 · Multilabel Classification · Dutch28#103
MTEB Dutch v1 · Pair Classification · Dutch57.9#127
MTEB Dutch v1 · Reranking · Dutch73.9#162
MTEB Polish v1 · Pair Classification · Polish60.5#132
MTEB Polish v1 · Classification · Polish39.7#115
MTEB Portuguese v1 · Classification · Portuguese47.1#27
MTEB Portuguese v1 · Multilabel Classification · Portuguese18.4#134
MTEB Law v1 · Mean over tasks · multilingual (3 languages)37.4#107
MTEB Law v1 · Mean over task types · multilingual (3 languages)37.4#107
MTEB Law v1 · Retrieval · multilingual (3 languages)37.4#107
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)32.7#93
MTEB Medical v1 · Mean over task types · multilingual (10 languages)30.1#91
MTEB Medical v1 · Retrieval · multilingual (10 languages)33#94
MTEB Medical v1 · Clustering · English38.4#59
MTEB Medical v1 · Reranking · Mandarin Chinese18.8#146
FollowIR · Mean over tasks · English-3.1#166
FollowIR · Mean over task types · English-3.1#166
FollowIR · Instruction Reranking · English-3.1#166
MTEB Spanish v1 · Clustering · Spanish39.5#88
MTEB Spanish v1 · Reranking · Spanish26.5#107
MTEB Thai v1 · Mean over tasks · multilingual (2 languages)12.2#27
MTEB Thai v1 · Mean over task types · multilingual (2 languages)16.8#27
MTEB Thai v1 · Clustering · Thai3.3#168
MTEB Thai v1 · Classification · Thai16.7#32
MTEB Thai v1 · Pair Classification · Thai51.1#165
MTEB Thai v1 · Retrieval · multilingual (2 languages)7.2#28
MTEB Thai v1 · Reranking · Thai5.6#30
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)32.3#105
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)33#48
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)58.6#146
MTEB Russian v1.1 · Classification · Russian28.8#121
MTEB Russian v1.1 · Reranking · Russian20.4#120
MTEB Russian v1.1 · Clustering · Russian15.8#121
MTEB Russian v1.1 · Pair Classification · Russian44.5#193
MTEB Russian v1.1 · Multilabel Classification · Russian26.9#98
RTEB Finnish beta · Mean over tasks · English55.9#53
RTEB French beta · Mean over tasks · multilingual (2 languages)12.6#158
RTEB German beta · Mean over tasks · German10.7#178
RTEB Health beta · Mean over tasks · multilingual (4 languages)37.7#72
RTEB Law beta · Mean over tasks · multilingual (4 languages)28.3#157
MTEB multilingual v2 · STS · multilingual (35 languages)57.6#85
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)21.2#145
MTEB multilingual v2 · Instruction Reranking · English-3.1#166
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)16.3#110

FAQ

How much does All Mpnet Base v2 cost?›

$0.005 per 1M tokens.

Is All Mpnet Base v2 free to use?›

There is no free API; the cheapest paid price is $0.005 per 1M input tokens. The weights are open, so you can run it yourself.

How good is All Mpnet Base v2, and what is it best at?›

#130 of 200 in Embeddings.

Is All Mpnet Base v2 better than Bekko Embedding v1 A25m?›

On ChemTEB · Clustering · English, All Mpnet Base v2 scores 50.5 vs 50.8 — about the same.

How can I use All Mpnet Base v2?›

Through the sentence-transformers API.

When was All Mpnet Base v2 released? Is there a newer version?›

Released 2021-08-30. It is the current version in its line.

Is All Mpnet Base v2 open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run All Mpnet Base v2 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is All Mpnet Base v2?›

All Mpnet Base v2 is an open-weights embeddings & retrieval model from sentence-transformers, released Aug 2021.

What are the best alternatives to All Mpnet Base v2?›

Cohere Embed English v3 (better), SearchMap Preview (open weights).