Benchmark By Score Rank
Retrieval 15
MTEB Mandarin Chinesev1 · Retrieval · Mandarin Chinese Embeddings rank relevant documents for queries on MTEB Chinese v1 · Retrieval in Mandarin Chinese MTEB 31.3 #79 of 86+7 versions & slices v1 · Pair Classification · Mandarin Chinese Embeddings classify relationships between pairs on MTEB Chinese v1 · Pair Classification in Mandarin Chinese MTEB 60 #70 of 85v1 · STS · Mandarin Chinese Embeddings estimate semantic similarity between pairs on MTEB Chinese v1 · STS in Mandarin Chinese MTEB 34.7 #72 of 85v1 · Clustering · Mandarin Chinese Embeddings group similar examples on MTEB Chinese v1 · Clustering in Mandarin Chinese MTEB 25.8 #73 of 84v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Chinese v1 · Reranking in Mandarin Chinese MTEB 40.4 #65 of 71v1 · Classification · Mandarin Chinese Embeddings assign examples to categories on MTEB Chinese v1 · Classification in Mandarin Chinese MTEB 57 #41 of 55v1 · Mean over tasks · Mandarin Chinese Embeddings estimate semantic similarity between pairs, group similar examples, reorder candidate documents by relevance, rank relevant documents for queries, assign examples to categories, classify relationships between pairs on MTEB Chinese v1 · mean over tasks in Mandarin Chinese; tasks receive equal weight MTEB 39.4 #35 of 35v1 · Mean over task types · Mandarin Chinese Embeddings estimate semantic similarity between pairs, group similar examples, reorder candidate documents by relevance, rank relevant documents for queries, assign examples to categories, classify relationships between pairs on MTEB Chinese v1 · mean over task types in Mandarin Chinese; task types receive equal weight MTEB 41.5 #35 of 35
ChemTEBRetrieval · English Embeddings rank relevant documents for queries on cheMTEB · Retrieval in English MTEB 42.7 #50 of 51+6 versions & slices Bitext Mining · English Embeddings find translated sentence pairs on cheMTEB · Bitext Mining in English MTEB 0.1 #46 of 49Clustering · English Embeddings group similar examples on cheMTEB · Clustering in English MTEB 21.5 #49 of 49Pair Classification · multilingual (13 languages) Embeddings classify relationships between pairs on cheMTEB · Pair Classification in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish MTEB 44.2 #47 of 48Classification · English Embeddings assign examples to categories on cheMTEB · Classification in English MTEB 76.1 #45 of 46Mean over tasks · multilingual (13 languages) Embeddings rank relevant documents for queries, group similar examples, assign examples to categories, find translated sentence pairs, classify relationships between pairs on cheMTEB · mean over tasks in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; tasks receive equal weight MTEB 60.9 #45 of 45Mean over task types · multilingual (13 languages) Embeddings rank relevant documents for queries, group similar examples, assign examples to categories, find translated sentence pairs, classify relationships between pairs on cheMTEB · mean over task types in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; task types receive equal weight MTEB 36.9 #44 of 45
Reranking 37
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 80.5 #103 of 200+8 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 14.8 #113 of 133v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 26.1 #111 of 133v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 63.6 #84 of 133v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch MTEB 66.1 #71 of 133v1 · Classification · Dutch Embeddings assign examples to categories on MTEB Dutch v1 · Classification in Dutch MTEB 50.5 #74 of 131v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch MTEB 37.9 #79 of 131v1 · Mean over tasks · Dutch Embeddings rank relevant documents for queries, assign examples to categories, assign multiple labels to each example, estimate semantic similarity between pairs, group similar examples, reorder candidate documents by relevance, classify relationships between pairs on MTEB Dutch v1 · mean over tasks in Dutch; tasks receive equal weight MTEB 39.9 #83 of 129v1 · Mean over task types · Dutch Embeddings rank relevant documents for queries, assign examples to categories, assign multiple labels to each example, estimate semantic similarity between pairs, group similar examples, reorder candidate documents by relevance, classify relationships between pairs on MTEB Dutch v1 · mean over task types in Dutch; task types receive equal weight MTEB 48.5 #79 of 129
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB -1.2 #88 of 192+10 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 77.7 #80 of 175v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish MTEB 47.4 #125 of 175v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 4 #164 of 173v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 26.3 #147 of 167v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 84.9 #68 of 154v1 · Retrieval · multilingual (25 languages) Embeddings rank relevant documents for queries on MTEB Europe v1 · Retrieval in 25 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 45.2 #60 of 153v1 · Classification · multilingual (23 languages) Embeddings assign examples to categories on MTEB Europe v1 · Classification in 23 languages including Bulgarian, Czech, Danish, Dutch, English, Estonian, Finnish, French MTEB 47.2 #114 of 138v1 · STS · multilingual (8 languages) Embeddings estimate semantic similarity between pairs on MTEB Europe v1 · STS in Dutch, English, Finnish, French, German, Italian, Polish, Spanish MTEB 66.8 #59 of 105v1 · Mean over tasks · multilingual (29 languages) Embeddings assign examples to categories, rerank documents according to instructions, assign multiple labels to each example, estimate semantic similarity between pairs, classify relationships between pairs, group similar examples, rank relevant documents for queries, reorder candidate documents by relevance, find translated sentence pairs on MTEB Europe v1 · mean over tasks in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian; tasks receive equal weight MTEB 49.8 #34 of 68v1 · Mean over task types · multilingual (29 languages) Embeddings assign examples to categories, rerank documents according to instructions, assign multiple labels to each example, estimate semantic similarity between pairs, classify relationships between pairs, group similar examples, rank relevant documents for queries, reorder candidate documents by relevance, find translated sentence pairs on MTEB Europe v1 · mean over task types in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian; task types receive equal weight MTEB 44.2 #36 of 68
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB -1.2 #88 of 192+10 versions & slices v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali MTEB 41.2 #85 of 176v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 50.6 #76 of 173v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 13.8 #148 of 173v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French MTEB 49.4 #83 of 173v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French MTEB 74.3 #84 of 166v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian MTEB 30.7 #143 of 160v2 · Classification · multilingual (119 languages) Embeddings assign examples to categories on MTEB Multilingual v2 · Classification in 119 languages including Achinese, Afrikaans, Albanian, Algerian Arabic, Amharic, Arabic, Armenian, Assamese MTEB 48.6 #93 of 154v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 64 #65 of 120v2 · Mean over tasks · multilingual (1037 languages) Embeddings group similar examples, estimate semantic similarity between pairs, assign examples to categories, rank relevant documents for queries, assign multiple labels to each example, find translated sentence pairs, rerank documents according to instructions, reorder candidate documents by relevance, classify relationships between pairs on MTEB Multilingual v2 · mean over tasks in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; tasks receive equal weight MTEB 47.2 #57 of 91v2 · Mean over task types · multilingual (1037 languages) Embeddings group similar examples, estimate semantic similarity between pairs, assign examples to categories, rank relevant documents for queries, assign multiple labels to each example, find translated sentence pairs, rerank documents according to instructions, reorder candidate documents by relevance, classify relationships between pairs on MTEB Multilingual v2 · mean over task types in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; task types receive equal weight MTEB 41.3 #57 of 91
MTEB Persianv2 · Reranking · Persian Embeddings reorder candidate documents by relevance on MTEB Persian v2 · Reranking in Persian MTEB 53.3 #58 of 149+5 versions & slices v2 · Bitext Mining · Persian Embeddings find translated sentence pairs on MTEB Persian v2 · Bitext Mining in Persian MTEB 37.1 #37 of 44v2 · Clustering · Persian Embeddings group similar examples on MTEB Persian v2 · Clustering in Persian MTEB 46.5 #44 of 44v2 · STS · Persian Embeddings estimate semantic similarity between pairs on MTEB Persian v2 · STS in Persian MTEB 70.8 #35 of 43v2 · Pair Classification · Persian Embeddings classify relationships between pairs on MTEB Persian v2 · Pair Classification in Persian MTEB 74.5 #36 of 42v2 · Classification · Persian Embeddings assign examples to categories on MTEB Persian v2 · Classification in Persian MTEB 61.9 #27 of 35
Other 134
MTEB Englishv2 · Pair Classification · English Embeddings classify relationships between pairs in English MTEB 79 #191 of 238+6 versions & slices v2 · Reranking · English Embeddings reorder candidate documents by relevance in English MTEB 41.6 #192 of 223v2 · Classification · English Embeddings assign examples to categories in English MTEB 66.2 #197 of 222v2 · Summarization · English Embeddings match summaries to their source meaning in English MTEB 26.2 #168 of 209v2 · Clustering · English Embeddings group similar examples in English MTEB 31.2 #199 of 207v2 · STS · English Embeddings estimate semantic similarity between pairs in English MTEB 74.5 #164 of 200v2 · Retrieval · English Embeddings rank relevant documents for queries in English MTEB 28.8 #164 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 25.2 #203 of 220+4 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 43.1 #101 of 202v1 · Retrieval · multilingual (10 languages) Embeddings rank relevant documents for queries on MTEB Medical v1 · Retrieval in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese MTEB 32.4 #99 of 140v1 · Mean over tasks · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over tasks in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; tasks receive equal weight MTEB 32.1 #99 of 138v1 · Mean over task types · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over task types in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; task types receive equal weight MTEB 33.6 #75 of 138
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 17.2 #138 of 215
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 41.1 #85 of 212
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 33.7 #110 of 209
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 70.8 #35 of 206+5 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 26.1 #139 of 175v1 · Classification · multilingual (6 languages) Embeddings assign examples to categories on MTEB Scandinavian v1 · Classification in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish MTEB 48.7 #98 of 158v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish MTEB 45.7 #62 of 144v1 · Mean over tasks · multilingual (6 languages) Embeddings assign examples to categories, rank relevant documents for queries, group similar examples, find translated sentence pairs on MTEB Scandinavian v1 · mean over tasks in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; tasks receive equal weight MTEB 44.7 #71 of 135v1 · Mean over task types · multilingual (6 languages) Embeddings assign examples to categories, rank relevant documents for queries, group similar examples, find translated sentence pairs on MTEB Scandinavian v1 · mean over task types in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; task types receive equal weight MTEB 47.8 #60 of 135
BEIRMean over tasks · English Embeddings rank relevant documents for queries on BEIR · mean over tasks in English; tasks receive equal weight MTEB 28.3 #166 of 196+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BEIR · mean over task types in English; task types receive equal weight MTEB 28.3 #166 of 196Retrieval · English Embeddings rank relevant documents for queries on BEIR · Retrieval in English MTEB 28.3 #166 of 196
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 58.5 #49 of 194+8 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 27.8 #92 of 162v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 29.7 #94 of 158v1.1 · Reranking · Russian Embeddings reorder candidate documents by relevance on MTEB Russian v1.1 · Reranking in Russian MTEB 38 #76 of 153v1.1 · Classification · Russian Embeddings assign examples to categories on MTEB Russian v1.1 · Classification in Russian MTEB 44.9 #88 of 146v1.1 · STS · Russian Embeddings estimate semantic similarity between pairs on MTEB Russian v1.1 · STS in Russian MTEB 61.7 #73 of 139v1.1 · Retrieval · Russian Embeddings rank relevant documents for queries on MTEB Russian v1.1 · Retrieval in Russian MTEB 28.1 #50 of 109v1.1 · Mean over tasks · Russian Embeddings assign examples to categories, group similar examples, reorder candidate documents by relevance, assign multiple labels to each example, estimate semantic similarity between pairs, rank relevant documents for queries, classify relationships between pairs on MTEB Russian v1.1 · mean over tasks in Russian; tasks receive equal weight MTEB 41.4 #56 of 106v1.1 · Mean over task types · Russian Embeddings assign examples to categories, group similar examples, reorder candidate documents by relevance, assign multiple labels to each example, estimate semantic similarity between pairs, rank relevant documents for queries, classify relationships between pairs on MTEB Russian v1.1 · mean over task types in Russian; task types receive equal weight MTEB 41.2 #52 of 106
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 19.8 #86 of 193+6 versions & slices v1 · Classification · Portuguese Embeddings assign examples to categories on MTEB Portuguese v1 · Classification in Portuguese MTEB 51.3 #40 of 49v1 · STS · Portuguese Embeddings estimate semantic similarity between pairs on MTEB Portuguese v1 · STS in Portuguese MTEB 66.5 #35 of 44v1 · Reranking · Portuguese Embeddings reorder candidate documents by relevance on MTEB Portuguese v1 · Reranking in Portuguese MTEB 83 #15 of 33v1 · Mean over tasks · Portuguese Embeddings reorder candidate documents by relevance, assign examples to categories, estimate semantic similarity between pairs, assign multiple labels to each example, rank relevant documents for queries on MTEB Portuguese v1 · mean over tasks in Portuguese; tasks receive equal weight MTEB 59.4 #20 of 22v1 · Mean over task types · Portuguese Embeddings reorder candidate documents by relevance, assign examples to categories, estimate semantic similarity between pairs, assign multiple labels to each example, rank relevant documents for queries on MTEB Portuguese v1 · mean over task types in Portuguese; task types receive equal weight MTEB 54.6 #19 of 22v1 · Retrieval · Portuguese Embeddings rank relevant documents for queries on MTEB Portuguese v1 · Retrieval in Portuguese MTEB 52.6 #19 of 22
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB -1.2 #88 of 192+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB -1.2 #88 of 192Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB -1.2 #88 of 192
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 8 #105 of 192+8 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 5.7 #103 of 187v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 74.3 #84 of 183v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 65.3 #73 of 179v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 16 #62 of 162v1 · Retrieval · multilingual (14 languages) Embeddings rank relevant documents for queries on MTEB Indic v1 · Retrieval in Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Nepali (individual language), Odia, Panjabi, Sindhi, Tamil, Telugu, Urdu MTEB 48 #68 of 153v1 · Classification · multilingual (8 languages) Embeddings assign examples to categories on MTEB Indic v1 · Classification in Bengali, Gujarati, Hindi, Malayalam, Nepali (macrolanguage), Panjabi, Sanskrit, Urdu MTEB 50.4 #63 of 141v1 · Mean over tasks · multilingual (25 languages) Embeddings assign examples to categories, find translated sentence pairs, estimate semantic similarity between pairs, reorder candidate documents by relevance, rank relevant documents for queries, classify relationships between pairs, group similar examples on MTEB Indic v1 · mean over tasks in 25 languages including Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Dogri (macrolanguage), English, Goan Konkani; tasks receive equal weight MTEB 44.3 #57 of 125v1 · Mean over task types · multilingual (25 languages) Embeddings assign examples to categories, find translated sentence pairs, estimate semantic similarity between pairs, reorder candidate documents by relevance, rank relevant documents for queries, classify relationships between pairs, group similar examples on MTEB Indic v1 · mean over task types in 25 languages including Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Dogri (macrolanguage), English, Goan Konkani; task types receive equal weight MTEB 38.2 #53 of 125
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 3.2 #173 of 192+6 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 52.7 #112 of 182v1 · Classification · Thai Embeddings assign examples to categories on MTEB Thai v1 · Classification in Thai MTEB 16.2 #34 of 35v1 · Reranking · Thai Embeddings reorder candidate documents by relevance on MTEB Thai v1 · Reranking in Thai MTEB 7.1 #31 of 33v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Thai v1 · Retrieval in English, Thai MTEB 8.1 #25 of 27v1 · Mean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries, assign examples to categories, classify relationships between pairs, group similar examples, reorder candidate documents by relevance on MTEB Thai v1 · mean over tasks in English, Thai; tasks receive equal weight MTEB 12.8 #24 of 26v1 · Mean over task types · multilingual (2 languages) Embeddings rank relevant documents for queries, assign examples to categories, classify relationships between pairs, group similar examples, reorder candidate documents by relevance on MTEB Thai v1 · mean over task types in English, Thai; task types receive equal weight MTEB 17.5 #24 of 26
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 49.9 #177 of 188+8 versions & slices v1 · Summarization · French Embeddings match summaries to their source meaning on MTEB French v1 · Summarization in French MTEB 28.9 #131 of 158v1 · Reranking · French Embeddings reorder candidate documents by relevance on MTEB French v1 · Reranking in French MTEB 61.5 #106 of 144v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB French v1 · Retrieval in English, French MTEB 36.9 #77 of 138v1 · Classification · French Embeddings assign examples to categories on MTEB French v1 · Classification in French MTEB 57.4 #66 of 134v1 · Clustering · French Embeddings group similar examples on MTEB French v1 · Clustering in French MTEB 29.1 #106 of 120v1 · STS · French Embeddings estimate semantic similarity between pairs on MTEB French v1 · STS in French MTEB 73.4 #47 of 112v1 · Mean over tasks · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, rank relevant documents for queries, assign examples to categories, group similar examples, reorder candidate documents by relevance, classify relationships between pairs, match summaries to their source meaning on MTEB French v1 · mean over tasks in English, French; tasks receive equal weight MTEB 46.2 #67 of 102v1 · Mean over task types · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, rank relevant documents for queries, assign examples to categories, group similar examples, reorder candidate documents by relevance, classify relationships between pairs, match summaries to their source meaning on MTEB French v1 · mean over task types in English, French; task types receive equal weight MTEB 48.2 #68 of 102
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 46.6 #175 of 175+7 versions & slices v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German MTEB 58.8 #65 of 168v1 · Clustering · German Embeddings group similar examples on MTEB German v1 · Clustering in German MTEB 18 #121 of 167v1 · Reranking · German Embeddings reorder candidate documents by relevance on MTEB German v1 · Reranking in German MTEB 20.7 #103 of 148v1 · STS · German Embeddings estimate semantic similarity between pairs on MTEB German v1 · STS in German MTEB 55.3 #65 of 137v1 · Retrieval · German Embeddings rank relevant documents for queries on MTEB German v1 · Retrieval in German MTEB 40.4 #52 of 127v1 · Mean over tasks · German Embeddings assign examples to categories, classify relationships between pairs, estimate semantic similarity between pairs, group similar examples, rank relevant documents for queries, reorder candidate documents by relevance on MTEB German v1 · mean over tasks in German; tasks receive equal weight MTEB 42.7 #52 of 114v1 · Mean over task types · German Embeddings assign examples to categories, classify relationships between pairs, estimate semantic similarity between pairs, group similar examples, rank relevant documents for queries, reorder candidate documents by relevance on MTEB German v1 · mean over task types in German; task types receive equal weight MTEB 40 #57 of 114
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 56.2 #143 of 171+7 versions & slices v1 · Reranking · Spanish Embeddings reorder candidate documents by relevance on MTEB Spanish v1 · Reranking in Spanish MTEB 27.2 #103 of 148v1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 41.7 #66 of 127v1 · Classification · Spanish Embeddings assign examples to categories on MTEB Spanish v1 · Classification in Spanish MTEB 73.3 #65 of 101v1 · STS · multilingual (2 languages) Embeddings estimate semantic similarity between pairs on MTEB Spanish v1 · STS in English, Spanish MTEB 71.8 #40 of 88v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Spanish v1 · Retrieval in English, Spanish MTEB 32.7 #23 of 28v1 · Mean over tasks · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, group similar examples, rank relevant documents for queries, classify relationships between pairs, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over tasks in English, Spanish; tasks receive equal weight MTEB 51.3 #23 of 27v1 · Mean over task types · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, group similar examples, rank relevant documents for queries, classify relationships between pairs, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over task types in English, Spanish; task types receive equal weight MTEB 50.5 #23 of 27
JMTEBv2 · STS · Japanese Embeddings estimate semantic similarity between pairs on jMTEB v2 · STS in Japanese MTEB 76.7 #67 of 168+1 versions & slices v2 · Clustering · Japanese Embeddings group similar examples on jMTEB v2 · Clustering in Japanese MTEB 29 #75 of 161
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 60.4 #33 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 60.4 #33 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 60.4 #33 of 168
MTEB Lawv1 · Mean over tasks · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over tasks in Chinese, English, German; tasks receive equal weight MTEB 44.8 #64 of 167+2 versions & slices v1 · Mean over task types · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over task types in Chinese, English, German; task types receive equal weight MTEB 44.8 #64 of 167v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · Retrieval in Chinese, English, German MTEB 44.8 #64 of 167
MTEB Polishv1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 70.4 #78 of 159+5 versions & slices v1 · Classification · Polish Embeddings assign examples to categories on MTEB Polish v1 · Classification in Polish MTEB 48 #67 of 144v1 · STS · Polish Embeddings estimate semantic similarity between pairs on MTEB Polish v1 · STS in Polish MTEB 61 #54 of 132v1 · Clustering · Polish Embeddings group similar examples on MTEB Polish v1 · Clustering in Polish MTEB 21.8 #91 of 121v1 · Mean over tasks · Polish Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs on MTEB Polish v1 · mean over tasks in Polish; tasks receive equal weight MTEB 50.9 #44 of 103v1 · Mean over task types · Polish Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs on MTEB Polish v1 · mean over task types in Polish; task types receive equal weight MTEB 50.3 #45 of 103
MTEB Koreanv2 · Classification · Korean Embeddings assign examples to categories on MTEB Korean v2 · Classification in Korean MTEB 27.1 #71 of 156+7 versions & slices v2 · Reranking · Korean Embeddings reorder candidate documents by relevance on MTEB Korean v2 · Reranking in Korean MTEB 23.3 #69 of 155v2 · STS · Korean Embeddings estimate semantic similarity between pairs on MTEB Korean v2 · STS in Korean MTEB 62.3 #51 of 108v2 · Clustering · Korean Embeddings group similar examples on MTEB Korean v2 · Clustering in Korean MTEB 20.6 #36 of 40v2 · Pair Classification · Korean Embeddings classify relationships between pairs on MTEB Korean v2 · Pair Classification in Korean MTEB 56.7 #34 of 40v2 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Korean v2 · Retrieval in English, Korean MTEB 36.8 #36 of 39v2 · Mean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries, group similar examples, estimate semantic similarity between pairs, assign examples to categories, classify relationships between pairs, reorder candidate documents by relevance on MTEB Korean v2 · mean over tasks in English, Korean; tasks receive equal weight MTEB 40.1 #28 of 31v2 · Mean over task types · multilingual (2 languages) Embeddings rank relevant documents for queries, group similar examples, estimate semantic similarity between pairs, assign examples to categories, classify relationships between pairs, reorder candidate documents by relevance on MTEB Korean v2 · mean over task types in English, Korean; task types receive equal weight MTEB 37.8 #28 of 31
RTEB Finnish betaMean over tasks · English Embeddings rank relevant documents for queries on RTEB Finnish Beta · mean over tasks in English; tasks receive equal weight MTEB 29.8 #80 of 93
RTEB Health betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 17.5 #80 of 93
CoIRMean over tasks · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · mean over tasks in English, c++, go, java, javascript, php, python, ruby, sql; tasks receive equal weight MTEB 30.8 #61 of 62+2 versions & slices Mean over task types · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · mean over task types in English, c++, go, java, javascript, php, python, ruby, sql; task types receive equal weight MTEB 30.8 #61 of 62Retrieval · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · Retrieval in English, c++, go, java, javascript, php, python, ruby, sql MTEB 30.8 #61 of 62
MTEB Codev1 · Mean over tasks · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · mean over tasks in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript; tasks receive equal weight MTEB 32.2 #55 of 56+2 versions & slices v1 · Mean over task types · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · mean over task types in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript; task types receive equal weight MTEB 32.2 #55 of 56v1 · Retrieval · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · Retrieval in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript MTEB 32.2 #55 of 56
VN-MTEB Vietnamesev1 · Clustering · Vietnamese Embeddings group similar examples on Vn MTEB Vietnamese v1 · Clustering in Vietnamese MTEB 21.9 #31 of 32+7 versions & slices v1 · Reranking · Vietnamese Embeddings reorder candidate documents by relevance on Vn MTEB Vietnamese v1 · Reranking in Vietnamese MTEB 55 #28 of 32v1 · STS · Vietnamese Embeddings estimate semantic similarity between pairs on Vn MTEB Vietnamese v1 · STS in Vietnamese MTEB 65 #30 of 32v1 · Classification · Vietnamese Embeddings assign examples to categories on Vn MTEB Vietnamese v1 · Classification in Vietnamese MTEB 52.1 #28 of 30v1 · Retrieval · Vietnamese Embeddings rank relevant documents for queries on Vn MTEB Vietnamese v1 · Retrieval in Vietnamese MTEB 15.6 #26 of 29v1 · Pair Classification · Vietnamese Embeddings classify relationships between pairs on Vn MTEB Vietnamese v1 · Pair Classification in Vietnamese MTEB 74.9 #24 of 28v1 · Mean over tasks · Vietnamese Embeddings reorder candidate documents by relevance, classify relationships between pairs, rank relevant documents for queries, group similar examples, estimate semantic similarity between pairs, assign examples to categories on Vn MTEB Vietnamese v1 · mean over tasks in Vietnamese; tasks receive equal weight MTEB 33.9 #24 of 26v1 · Mean over task types · Vietnamese Embeddings reorder candidate documents by relevance, classify relationships between pairs, rank relevant documents for queries, group similar examples, estimate semantic similarity between pairs, assign examples to categories on Vn MTEB Vietnamese v1 · mean over task types in Vietnamese; task types receive equal weight MTEB 47.4 #24 of 26
BRIGHTMean over tasks · English Embeddings rank relevant documents for queries on BRIGHT · mean over tasks in English; tasks receive equal weight MTEB 6.2 #28 of 28+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BRIGHT · mean over task types in English; task types receive equal weight MTEB 6.2 #28 of 28Retrieval · English Embeddings rank relevant documents for queries on BRIGHT · Retrieval in English MTEB 6.2 #28 of 28
CoREBv1 · Mean over tasks · multilingual (6 languages) Embeddings rank relevant documents for queries, reorder candidate documents by relevance on CoReB v1 · mean over tasks in English, c++, go, java, python, ruby; tasks receive equal weight MTEB 24.9 #24 of 24+3 versions & slices v1 · Mean over task types · multilingual (6 languages) Embeddings rank relevant documents for queries, reorder candidate documents by relevance on CoReB v1 · mean over task types in English, c++, go, java, python, ruby; task types receive equal weight MTEB 24.9 #24 of 24v1 · Reranking · multilingual (6 languages) Embeddings reorder candidate documents by relevance on CoReB v1 · Reranking in English, c++, go, java, python, ruby MTEB 34.3 #23 of 24v1 · Retrieval · multilingual (6 languages) Embeddings rank relevant documents for queries on CoReB v1 · Retrieval in English, c++, go, java, python, ruby MTEB 15.5 #24 of 24
BEIR-NLMean over tasks · Dutch Embeddings rank relevant documents for queries on BEIR NL · mean over tasks in Dutch; tasks receive equal weight MTEB 21.7 #13 of 15+2 versions & slices Mean over task types · Dutch Embeddings rank relevant documents for queries on BEIR NL · mean over task types in Dutch; task types receive equal weight MTEB 21.7 #13 of 15Retrieval · Dutch Embeddings rank relevant documents for queries on BEIR NL · Retrieval in Dutch MTEB 21.7 #13 of 15
RTEB Code betaMean over tasks · multilingual (6 languages) Embeddings rank relevant documents for queries on RTEB Code Beta · mean over tasks in English, Japanese, go, javascript, python, sql; tasks receive equal weight MTEB 16.7 #9 of 10
RTEB English betaMean over tasks · multilingual (5 languages) Embeddings rank relevant documents for queries on RTEB English Beta · mean over tasks in English, go, javascript, python, sql; tasks receive equal weight MTEB 22.7 #9 of 10
No benchmark matches
BetterEmbeddingGemma 300MunstatedOpen+32%—$0.002Languages: not verified+1
OpenKaLM Embedding Gemma3 12B 2511+51%——Languages: not verified+1
BetterQwen 3 Embedding 8BunstatedOpen+49%—$0.01Languages: not verified+1
Llama Embed Nemotron 8BOpen+48%——Languages: not verified+1