a

German Semantic STS v2

Nov 2022
aGerman Semantic STS v2
Compare in
on
API price not publicprice
17.8MTEB English v2
Nov 2022released
1,024Dimensions
1K tokensMax input
deLanguages

Rankingconfiguration unstated?

Full ranking →
1Gte Qwen2 7B Instruct65.32German Semantic STS v263.23Gte Qwen1.5 7B Instruct624F2LLM v2 14B59.85F2LLM v2 8B59.1

Strong at

C
Embeddings & Retrieval#184 of 200

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
Licencenot verified

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English17.9#182
BEIR · Mean over task types · English17.9#182
BEIR · Retrieval · English17.9#182
MTEB Persian v2 · Reranking · Persian18.9#138
JMTEB v2 · Clustering · Japanese10.5#144
JMTEB v2 · STS · Japanese26#152
LongEmbed · Mean over tasks · English17.7#156
LongEmbed · Mean over task types · English17.7#156
LongEmbed · Retrieval · English17.7#156
MTEB German v1 · Mean over tasks · German53.2#21
MTEB German v1 · Mean over task types · German52.2#21
MTEB German v1 · Clustering · German29.5#47
MTEB German v1 · Retrieval · German47.2#29
MTEB German v1 · Classification · German67.2#34
MTEB German v1 · STS · German68.5#33
MTEB German v1 · Pair Classification · German63.2#2
MTEB German v1 · Reranking · German37.3#55
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)41.2#53
MTEB Europe v1 · Mean over task types · multilingual (29 languages)36.2#53
MTEB Europe v1 · Retrieval · multilingual (25 languages)26.8#120
MTEB Europe v1 · STS · multilingual (8 languages)63.5#57
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)36.4#126
MTEB Europe v1 · Classification · multilingual (23 languages)47.6#108
MTEB Europe v1 · Clustering · multilingual (29 languages)28.7#142
MTEB Europe v1 · Instruction Reranking · English-2.5#148
MTEB Europe v1 · Pair Classification · multilingual (11 languages)78.1#124
MTEB Europe v1 · Reranking · multilingual (12 languages)37.5#159
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)9.9#127
MTEB French v1 · Mean over tasks · multilingual (2 languages)39.8#84
MTEB French v1 · Mean over task types · multilingual (2 languages)42.4#85
MTEB French v1 · STS · French66.1#76
MTEB French v1 · Retrieval · multilingual (2 languages)17.6#114
MTEB French v1 · Reranking · French45.1#118
MTEB French v1 · Clustering · French33.1#95
MTEB French v1 · Classification · French50.5#99
MTEB French v1 · Summarization · French30#89
MTEB French v1 · Pair Classification · French54.5#151
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)31.2#113
MTEB Indic v1 · Mean over task types · multilingual (25 languages)20.9#112
MTEB Indic v1 · Classification · multilingual (8 languages)42.4#104
MTEB Indic v1 · Retrieval · multilingual (14 languages)6.6#134
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)5#90
MTEB Indic v1 · Reranking · multilingual (2 languages)33.3#179
MTEB Indic v1 · Pair Classification · Hindi51.4#165
MTEB Indic v1 · STS · multilingual (13 languages)4.2#132
MTEB Indic v1 · Clustering · multilingual (21 languages)3.4#142
MTEB Korean v2 · STS · Korean1.9#87
MTEB Korean v2 · Reranking · Korean4.7#142
MTEB Korean v2 · Classification · Korean18.8#142
MTEB Dutch v1 · Reranking · Dutch69.7#178
MTEB Polish v1 · Pair Classification · Polish64.7#95
MTEB Polish v1 · Classification · Polish43.2#74
MTEB Polish v1 · STS · Polish46.5#110
MTEB Portuguese v1 · Multilabel Classification · Portuguese18.9#118
MTEB Law v1 · Mean over tasks · multilingual (3 languages)34.6#125
MTEB Law v1 · Mean over task types · multilingual (3 languages)34.6#125
MTEB Law v1 · Retrieval · multilingual (3 languages)34.6#125
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)16.3#124
MTEB Medical v1 · Mean over task types · multilingual (10 languages)17#124
MTEB Medical v1 · Retrieval · multilingual (10 languages)14.5#126
MTEB Medical v1 · Clustering · English29#204
MTEB Medical v1 · Reranking · Mandarin Chinese7.7#196
FollowIR · Mean over tasks · English-2.5#148
FollowIR · Mean over task types · English-2.5#148
FollowIR · Instruction Reranking · English-2.5#148
MTEB Spanish v1 · Pair Classification · Spanish58.2#127
MTEB Spanish v1 · STS · multilingual (2 languages)61#58
MTEB Spanish v1 · Clustering · Spanish35.1#107
MTEB Spanish v1 · Reranking · Spanish16.9#130
MTEB Thai v1 · Clustering · Thai4.4#122
MTEB Thai v1 · Pair Classification · Thai52.8#113
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)29.6#120
MTEB Scandinavian v1 · Classification · multilingual (6 languages)47.4#125
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)54#172
MTEB Russian v1.1 · Mean over tasks · Russian18.4#102
MTEB Russian v1.1 · Mean over task types · Russian19.9#104
MTEB Russian v1.1 · Classification · Russian23.1#140
MTEB Russian v1.1 · STS · Russian16#133
MTEB Russian v1.1 · Reranking · Russian9.1#152
MTEB Russian v1.1 · Clustering · Russian14.7#133
MTEB Russian v1.1 · Pair Classification · Russian48.3#148
MTEB Russian v1.1 · Retrieval · Russian0.9#98
MTEB Russian v1.1 · Multilabel Classification · Russian26.8#100
RTEB French beta · Mean over tasks · multilingual (2 languages)5.2#179
RTEB German beta · Mean over tasks · German44#80
RTEB Law beta · Mean over tasks · multilingual (4 languages)32.7#122
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)38.3#82
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)32.4#82
MTEB multilingual v2 · Classification · multilingual (119 languages)44.2#140
MTEB multilingual v2 · Clustering · multilingual (208 languages)33.2#136
MTEB multilingual v2 · STS · multilingual (35 languages)53.3#95
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)71.7#128
MTEB multilingual v2 · Retrieval · multilingual (120 languages)21.8#162
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)22.9#134
MTEB multilingual v2 · Instruction Reranking · English-2.5#148
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)15.7#124
MTEB multilingual v2 · Reranking · multilingual (22 languages)31.7#171

FAQ

How much does German Semantic STS v2 cost?›

There is no per-unit API price: API price not public.

Is German Semantic STS v2 free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is German Semantic STS v2, and what is it best at?›

#184 of 200 in Embeddings.

Is German Semantic STS v2 better than Gte Qwen2 7B Instruct?›

On MTEB German v1 · Pair Classification · German, German Semantic STS v2 scores 63.2 vs 65.3 — lower.

When was German Semantic STS v2 released? Is there a newer version?›

Released 2022-11-17. It is the current version in its line.

Is German Semantic STS v2 open source?›

Yes, the weights are open.

Can I run German Semantic STS v2 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is German Semantic STS v2?›

German Semantic STS v2 is an open-weights embeddings & retrieval model from aari1995, released Nov 2022.

What are the best alternatives to German Semantic STS v2?›

Gte Qwen2 7B Instruct (better).