G

STS Multilingual Mpnet Base v2

Jun 2024
GSTS Multilingual Mpnet Base v2
Compare in
on
self-host onlyprice
25.5MTEB English v2
Jun 2024released
768Dimensions
0K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B76.72F2LLM v2 8B75.73FlowVec v175.14F2LLM v2 4B74.55F2LLM v2 1.7B71.6
···
44NV Embed v259.545STS Multilingual Mpnet Base v25946SFR Embedding Mistral58.8

Strong at

C
Embeddings & Retrieval#172 of 200

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
Licencenot verified

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English24.5#177
BEIR · Mean over task types · English24.5#177
BEIR · Retrieval · English24.5#177
MTEB Persian v2 · Reranking · Persian53.3#57
JMTEB v2 · Clustering · Japanese27.3#76
JMTEB v2 · STS · Japanese82.2#25
LongEmbed · Mean over tasks · English19.7#151
LongEmbed · Mean over task types · English19.7#151
LongEmbed · Retrieval · English19.7#151
MTEB German v1 · Mean over tasks · German45.8#33
MTEB German v1 · Mean over task types · German45.5#31
MTEB German v1 · Clustering · German20.7#109
MTEB German v1 · Retrieval · German32.8#77
MTEB German v1 · Classification · German61.4#56
MTEB German v1 · STS · German76.6#2
MTEB German v1 · Pair Classification · German52.7#51
MTEB German v1 · Reranking · German28.7#71
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)49.9#31
MTEB Europe v1 · Mean over task types · multilingual (29 languages)44.6#32
MTEB Europe v1 · Retrieval · multilingual (25 languages)36.9#98
MTEB Europe v1 · STS · multilingual (8 languages)64.5#53
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)80.5#78
MTEB Europe v1 · Classification · multilingual (23 languages)52.7#55
MTEB Europe v1 · Clustering · multilingual (29 languages)26.4#148
MTEB Europe v1 · Instruction Reranking · English-2#126
MTEB Europe v1 · Pair Classification · multilingual (11 languages)88.4#28
MTEB Europe v1 · Reranking · multilingual (12 languages)48.7#120
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)5.4#153
MTEB French v1 · Retrieval · multilingual (2 languages)38.8#64
MTEB French v1 · Reranking · French69#65
MTEB French v1 · Clustering · French30.9#102
MTEB French v1 · Classification · French60.1#55
MTEB French v1 · Summarization · French29.2#115
MTEB French v1 · Pair Classification · French57.1#108
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)57.8#40
MTEB Indic v1 · Mean over task types · multilingual (25 languages)58.2#29
MTEB Indic v1 · Classification · multilingual (8 languages)59#45
MTEB Indic v1 · Retrieval · multilingual (14 languages)52.3#58
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)47.7#45
MTEB Indic v1 · Reranking · multilingual (2 languages)71.7#94
MTEB Indic v1 · Pair Classification · Hindi73.8#43
MTEB Indic v1 · STS · multilingual (13 languages)84.8#1
MTEB Indic v1 · Clustering · multilingual (21 languages)18.1#90
MTEB Korean v2 · STS · Korean60.8#46
MTEB Korean v2 · Reranking · Korean33.3#58
MTEB Korean v2 · Classification · Korean43.6#57
MTEB Dutch v1 · Mean over tasks · Dutch45.4#63
MTEB Dutch v1 · Mean over task types · Dutch57.3#56
MTEB Dutch v1 · Classification · Dutch53.8#67
MTEB Dutch v1 · Clustering · Dutch23.6#80
MTEB Dutch v1 · Retrieval · Dutch38.3#76
MTEB Dutch v1 · STS · Dutch92#1
MTEB Dutch v1 · Multilabel Classification · Dutch31.5#72
MTEB Dutch v1 · Pair Classification · Dutch81.2#12
MTEB Dutch v1 · Reranking · Dutch80.8#106
MTEB Polish v1 · Pair Classification · Polish90.9#1
MTEB Polish v1 · Classification · Polish51.7#57
MTEB Portuguese v1 · Multilabel Classification · Portuguese25.5#12
MTEB Law v1 · Mean over tasks · multilingual (3 languages)32.3#134
MTEB Law v1 · Mean over task types · multilingual (3 languages)32.3#134
MTEB Law v1 · Retrieval · multilingual (3 languages)32.3#134
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)31.9#97
MTEB Medical v1 · Mean over task types · multilingual (10 languages)35.4#54
MTEB Medical v1 · Retrieval · multilingual (10 languages)31#101
MTEB Medical v1 · Clustering · English28.7#206
MTEB Medical v1 · Reranking · Mandarin Chinese46.5#100
FollowIR · Mean over tasks · English-2#126
FollowIR · Mean over task types · English-2#126
FollowIR · Instruction Reranking · English-2#126
MTEB Spanish v1 · Pair Classification · Spanish67.2#53
MTEB Spanish v1 · Clustering · Spanish34#111
MTEB Spanish v1 · Reranking · Spanish37.7#79
MTEB Thai v1 · Clustering · Thai26.2#100
MTEB Thai v1 · Pair Classification · Thai77#33
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)30.6#118
MTEB Scandinavian v1 · Classification · multilingual (6 languages)55.3#61
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)54.1#171
MTEB Russian v1.1 · Classification · Russian51.5#82
MTEB Russian v1.1 · Reranking · Russian42.7#69
MTEB Russian v1.1 · Clustering · Russian44#82
MTEB Russian v1.1 · Pair Classification · Russian56.9#68
MTEB Russian v1.1 · Multilabel Classification · Russian31.3#70
RTEB French beta · Mean over tasks · multilingual (2 languages)19.7#130
RTEB German beta · Mean over tasks · German14.8#150
RTEB Law beta · Mean over tasks · multilingual (4 languages)23.9#182
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)48.5#58
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)42.4#57
MTEB multilingual v2 · Classification · multilingual (119 languages)51#78
MTEB multilingual v2 · Clustering · multilingual (208 languages)32.4#139
MTEB multilingual v2 · STS · multilingual (35 languages)72.4#43
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)78.7#51
MTEB multilingual v2 · Retrieval · multilingual (120 languages)34.7#130
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)47.6#85
MTEB multilingual v2 · Instruction Reranking · English-2#126
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)16.6#103
MTEB multilingual v2 · Reranking · multilingual (22 languages)50#88

FAQ

How much does STS Multilingual Mpnet Base v2 cost?›

There is no per-unit API price: self-host only.

Is STS Multilingual Mpnet Base v2 free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is STS Multilingual Mpnet Base v2, and what is it best at?›

#172 of 200 in Embeddings.

Is STS Multilingual Mpnet Base v2 better than NV Embed v2?›

On MTEB Indic v1 · Classification · multilingual (8 languages), STS Multilingual Mpnet Base v2 scores 59 vs 59.5 — about the same.

When was STS Multilingual Mpnet Base v2 released? Is there a newer version?›

Released 2024-06-07. It is the current version in its line.

Is STS Multilingual Mpnet Base v2 open source?›

Yes, the weights are open.

Can I run STS Multilingual Mpnet Base v2 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is STS Multilingual Mpnet Base v2?›

STS Multilingual Mpnet Base v2 is an open-weights embeddings & retrieval model from Gameselo, released Jun 2024.

What are the best alternatives to STS Multilingual Mpnet Base v2?›

Multilingual E5 Large Instruct (better), F2LLM v2 8B (open weights).