Benchmark By Score Rank
Reranking 15
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 75.6 #146 of 200
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB -1.1 #82 of 192+5 versions & slices v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish MTEB 40.6 #145 of 175v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 32 #131 of 167v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 81.7 #111 of 154v1 · Retrieval · multilingual (25 languages) Embeddings rank relevant documents for queries on MTEB Europe v1 · Retrieval in 25 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 32.3 #122 of 153v1 · Classification · multilingual (23 languages) Embeddings assign examples to categories on MTEB Europe v1 · Classification in 23 languages including Bulgarian, Czech, Danish, Dutch, English, Estonian, Finnish, French MTEB 55.2 #46 of 138
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB -1.1 #82 of 192+5 versions & slices v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali MTEB 30.6 #142 of 176v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French MTEB 44.1 #113 of 173v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French MTEB 72.4 #104 of 166v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian MTEB 38.2 #113 of 160v2 · Classification · multilingual (119 languages) Embeddings assign examples to categories on MTEB Multilingual v2 · Classification in 119 languages including Achinese, Afrikaans, Albanian, Algerian Arabic, Amharic, Arabic, Armenian, Assamese MTEB 54.7 #61 of 154
MTEB Koreanv2 · Reranking · Korean Embeddings reorder candidate documents by relevance on MTEB Korean v2 · Reranking in Korean MTEB 28.8 #64 of 155
MTEB Persianv2 · Reranking · Persian Embeddings reorder candidate documents by relevance on MTEB Persian v2 · Reranking in Persian MTEB 47 #62 of 149
Other 63
MTEB Englishv2 · Pair Classification · English Embeddings classify relationships between pairs in English MTEB 80.9 #177 of 238+6 versions & slices v2 · Reranking · English Embeddings reorder candidate documents by relevance in English MTEB 44.2 #170 of 223v2 · Classification · English Embeddings assign examples to categories in English MTEB 75.7 #118 of 222v2 · Summarization · English Embeddings match summaries to their source meaning in English MTEB 26.7 #166 of 209v2 · Clustering · English Embeddings group similar examples in English MTEB 40.7 #159 of 207v2 · STS · English Embeddings estimate semantic similarity between pairs in English MTEB 78.2 #136 of 200v2 · Retrieval · English Embeddings rank relevant documents for queries in English MTEB 31 #162 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 31.4 #171 of 220+4 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 48 #96 of 202v1 · Retrieval · multilingual (10 languages) Embeddings rank relevant documents for queries on MTEB Medical v1 · Retrieval in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese MTEB 33.3 #96 of 140v1 · Mean over tasks · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over tasks in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; tasks receive equal weight MTEB 34.2 #92 of 138v1 · Mean over task types · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over task types in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; task types receive equal weight MTEB 37.6 #53 of 138
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 3.5 #183 of 215
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 14.6 #152 of 212
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 24.6 #178 of 209
BEIRMean over tasks · English Embeddings rank relevant documents for queries on BEIR · mean over tasks in English; tasks receive equal weight MTEB 38.1 #151 of 196+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BEIR · mean over task types in English; task types receive equal weight MTEB 38.1 #151 of 196Retrieval · English Embeddings rank relevant documents for queries on BEIR · Retrieval in English MTEB 38.1 #151 of 196
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 50.2 #131 of 194+5 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 27.8 #91 of 162v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 37 #92 of 158v1.1 · Reranking · Russian Embeddings reorder candidate documents by relevance on MTEB Russian v1.1 · Reranking in Russian MTEB 36.3 #78 of 153v1.1 · Classification · Russian Embeddings assign examples to categories on MTEB Russian v1.1 · Classification in Russian MTEB 54 #74 of 146v1.1 · STS · Russian Embeddings estimate semantic similarity between pairs on MTEB Russian v1.1 · STS in Russian MTEB 48.6 #83 of 139
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB -1.1 #82 of 192+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB -1.1 #82 of 192Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB -1.1 #82 of 192
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 8.3 #104 of 192+5 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 5.3 #105 of 187v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 64.9 #92 of 183v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 53.5 #132 of 179v1 · Retrieval · multilingual (14 languages) Embeddings rank relevant documents for queries on MTEB Indic v1 · Retrieval in Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Nepali (individual language), Odia, Panjabi, Sindhi, Tamil, Telugu, Urdu MTEB 40.7 #70 of 153v1 · Classification · multilingual (8 languages) Embeddings assign examples to categories on MTEB Indic v1 · Classification in Bengali, Gujarati, Hindi, Malayalam, Nepali (macrolanguage), Panjabi, Sanskrit, Urdu MTEB 52.1 #62 of 141
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 9.3 #106 of 192+1 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 54.5 #101 of 182
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 64.6 #33 of 188+8 versions & slices v1 · Summarization · French Embeddings match summaries to their source meaning on MTEB French v1 · Summarization in French MTEB 30.9 #39 of 158v1 · Reranking · French Embeddings reorder candidate documents by relevance on MTEB French v1 · Reranking in French MTEB 51.1 #115 of 144v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB French v1 · Retrieval in English, French MTEB 19.5 #117 of 138v1 · Classification · French Embeddings assign examples to categories on MTEB French v1 · Classification in French MTEB 62.6 #51 of 134v1 · Clustering · French Embeddings group similar examples on MTEB French v1 · Clustering in French MTEB 35.8 #87 of 120v1 · STS · French Embeddings estimate semantic similarity between pairs on MTEB French v1 · STS in French MTEB 56.6 #99 of 112v1 · Mean over tasks · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, rank relevant documents for queries, assign examples to categories, group similar examples, reorder candidate documents by relevance, classify relationships between pairs, match summaries to their source meaning on MTEB French v1 · mean over tasks in English, French; tasks receive equal weight MTEB 43.7 #76 of 102v1 · Mean over task types · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, rank relevant documents for queries, assign examples to categories, group similar examples, reorder candidate documents by relevance, classify relationships between pairs, match summaries to their source meaning on MTEB French v1 · mean over task types in English, French; task types receive equal weight MTEB 45.9 #76 of 102
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 53.9 #38 of 175+4 versions & slices v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German MTEB 63.1 #55 of 168v1 · Clustering · German Embeddings group similar examples on MTEB German v1 · Clustering in German MTEB 24.5 #91 of 167v1 · Reranking · German Embeddings reorder candidate documents by relevance on MTEB German v1 · Reranking in German MTEB 24 #88 of 148v1 · STS · German Embeddings estimate semantic similarity between pairs on MTEB German v1 · STS in German MTEB 45.8 #111 of 137
MTEB Scandinavianv1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 35.7 #73 of 175
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 59.3 #110 of 171+2 versions & slices v1 · Reranking · Spanish Embeddings reorder candidate documents by relevance on MTEB Spanish v1 · Reranking in Spanish MTEB 27.3 #102 of 148v1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 43.6 #49 of 127
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 29.8 #124 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 29.8 #124 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 29.8 #124 of 168
MTEB Lawv1 · Mean over tasks · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over tasks in Chinese, English, German; tasks receive equal weight MTEB 27 #148 of 167+2 versions & slices v1 · Mean over task types · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over task types in Chinese, English, German; task types receive equal weight MTEB 27 #148 of 167v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · Retrieval in Chinese, English, German MTEB 27 #148 of 167
JMTEBv2 · Clustering · Japanese Embeddings group similar examples on jMTEB v2 · Clustering in Japanese MTEB 23 #86 of 161
MTEB Polishv1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 65.7 #92 of 159+2 versions & slices v1 · Classification · Polish Embeddings assign examples to categories on MTEB Polish v1 · Classification in Polish MTEB 54 #58 of 144v1 · STS · Polish Embeddings estimate semantic similarity between pairs on MTEB Polish v1 · STS in Polish MTEB 49.9 #110 of 132
No benchmark matches
BetterBge Base En v1.5unstatedOpen+11%—$0.005Max input: 33K tokens → 1K tokenssBetterAll MiniLM L6 v2unstatedOpen+5%—$0.005Max input: 33K tokens → 0K tokens