Benchmark By Score Rank
Retrieval 7
ChemTEBRetrieval · English Embeddings rank relevant documents for queries on cheMTEB · Retrieval in English MTEB 73.9 #13 of 48+6 versions & slices Bitext Mining · English Embeddings find translated sentence pairs on cheMTEB · Bitext Mining in English MTEB 0.2 #29 of 46Classification · English Embeddings assign examples to categories on cheMTEB · Classification in English MTEB 82.2 #17 of 46Clustering · English Embeddings group similar examples on cheMTEB · Clustering in English MTEB 39.2 #28 of 46Mean over tasks · multilingual (13 languages) Embeddings assign examples to categories, rank relevant documents for queries, classify relationships between pairs, group similar examples, find translated sentence pairs on cheMTEB · mean over tasks in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; tasks receive equal weight MTEB 70.9 #18 of 45Mean over task types · multilingual (13 languages) Embeddings assign examples to categories, rank relevant documents for queries, classify relationships between pairs, group similar examples, find translated sentence pairs on cheMTEB · mean over task types in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; task types receive equal weight MTEB 50.7 #21 of 45Pair Classification · multilingual (13 languages) Embeddings classify relationships between pairs on cheMTEB · Pair Classification in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish MTEB 58 #21 of 45
Reranking 35
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 79.6 #113 of 199+8 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 25 #74 of 133v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 31.9 #67 of 133v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 60.4 #97 of 133v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch MTEB 63 #81 of 133v1 · Classification · Dutch Embeddings assign examples to categories on MTEB Dutch v1 · Classification in Dutch MTEB 48.3 #83 of 131v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch MTEB 42.5 #64 of 131v1 · Mean over tasks · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over tasks in Dutch; tasks receive equal weight MTEB 42.8 #70 of 129v1 · Mean over task types · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over task types in Dutch; task types receive equal weight MTEB 50.1 #71 of 129
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB -2.3 #128 of 191+10 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 41.8 #102 of 174v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish MTEB 51.9 #81 of 174v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 13.6 #75 of 172v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 37.1 #81 of 166v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 84.1 #71 of 141v1 · Retrieval · multilingual (25 languages) Embeddings rank relevant documents for queries on MTEB Europe v1 · Retrieval in 25 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 42.3 #66 of 140v1 · Classification · multilingual (23 languages) Embeddings assign examples to categories on MTEB Europe v1 · Classification in 23 languages including Bulgarian, Czech, Danish, Dutch, English, Estonian, Finnish, French MTEB 51.1 #70 of 135v1 · STS · multilingual (8 languages) Embeddings estimate semantic similarity between pairs on MTEB Europe v1 · STS in Dutch, English, Finnish, French, German, Italian, Polish, Spanish MTEB 68.2 #43 of 85v1 · Mean over tasks · multilingual (29 languages) Embeddings rank relevant documents for queries, estimate semantic similarity between pairs, find translated sentence pairs, assign examples to categories, group similar examples, rerank documents according to instructions, classify relationships between pairs, reorder candidate documents by relevance, assign multiple labels to each example on MTEB Europe v1 · mean over tasks in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian; tasks receive equal weight MTEB 48.5 #40 of 59v1 · Mean over task types · multilingual (29 languages) Embeddings rank relevant documents for queries, estimate semantic similarity between pairs, find translated sentence pairs, assign examples to categories, group similar examples, rerank documents according to instructions, classify relationships between pairs, reorder candidate documents by relevance, assign multiple labels to each example on MTEB Europe v1 · mean over task types in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian; task types receive equal weight MTEB 43.1 #39 of 59
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB -2.3 #128 of 191+10 versions & slices v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali MTEB 39 #97 of 174v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 26.7 #107 of 172v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 17.7 #80 of 172v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French MTEB 48.8 #85 of 172v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French MTEB 72 #110 of 165v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian MTEB 41.4 #72 of 159v2 · Classification · multilingual (119 languages) Embeddings assign examples to categories on MTEB Multilingual v2 · Classification in 119 languages including Achinese, Afrikaans, Albanian, Algerian Arabic, Amharic, Arabic, Armenian, Assamese MTEB 48 #99 of 153v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 60.1 #72 of 112v2 · Mean over tasks · multilingual (1037 languages) Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs, rank relevant documents for queries, find translated sentence pairs, rerank documents according to instructions, assign multiple labels to each example, reorder candidate documents by relevance on MTEB Multilingual v2 · mean over tasks in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; tasks receive equal weight MTEB 45.1 #64 of 83v2 · Mean over task types · multilingual (1037 languages) Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs, rank relevant documents for queries, find translated sentence pairs, rerank documents according to instructions, assign multiple labels to each example, reorder candidate documents by relevance on MTEB Multilingual v2 · mean over task types in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; task types receive equal weight MTEB 39.1 #62 of 83
MTEB Koreanv2 · Reranking · Korean Embeddings reorder candidate documents by relevance on MTEB Korean v2 · Reranking in Korean MTEB 23.8 #66 of 150+2 versions & slices v2 · Classification · Korean Embeddings assign examples to categories on MTEB Korean v2 · Classification in Korean MTEB 20.6 #122 of 147v2 · STS · Korean Embeddings estimate semantic similarity between pairs on MTEB Korean v2 · STS in Korean MTEB 34.7 #69 of 92
MTEB Persianv2 · Reranking · Persian Embeddings reorder candidate documents by relevance on MTEB Persian v2 · Reranking in Persian MTEB 43.3 #71 of 149
Other 79
MTEB Englishv2 · Pair Classification · English MTEB English v2 · Pair Classification · English: embeddings classify relationships between pairs in English MTEB 87.1 #38 of 238+6 versions & slices v2 · Reranking · English MTEB English v2 · Reranking · English: embeddings reorder candidate documents by relevance in English MTEB 48.3 #56 of 223v2 · Classification · English MTEB English v2 · Classification · English: embeddings assign examples to categories in English MTEB 78.3 #88 of 222v2 · Summarization · English MTEB English v2 · Summarization · English: embeddings match summaries to their source meaning in English MTEB 33.1 #52 of 208v2 · Clustering · English MTEB English v2 · Clustering · English: embeddings group similar examples in English MTEB 48 #66 of 207v2 · STS · English MTEB English v2 · STS · English: embeddings estimate semantic similarity between pairs in English MTEB 82.8 #58 of 200v2 · Retrieval · English MTEB English v2 · Retrieval · English: embeddings rank relevant documents for queries in English MTEB 55.4 #57 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 35.4 #113 of 220+1 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 19.3 #138 of 199
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 26.4 #102 of 212
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 16.6 #129 of 206
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 62.3 #112 of 205+2 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 34.8 #78 of 170v1 · Classification · multilingual (6 languages) Embeddings assign examples to categories on MTEB Scandinavian v1 · Classification in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish MTEB 48.7 #95 of 151
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 31.7 #125 of 204
BEIRMean over tasks · English Embeddings rank relevant documents for queries on BEIR · mean over tasks in English; tasks receive equal weight MTEB 54.3 #52 of 194+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BEIR · mean over task types in English; task types receive equal weight MTEB 54.3 #52 of 194Retrieval · English Embeddings rank relevant documents for queries on BEIR · Retrieval in English MTEB 54.3 #52 of 194
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 47.6 #157 of 193+8 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 27.1 #96 of 159v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 19 #106 of 155v1.1 · Reranking · Russian Embeddings reorder candidate documents by relevance on MTEB Russian v1.1 · Reranking in Russian MTEB 36.8 #77 of 153v1.1 · Classification · Russian Embeddings assign examples to categories on MTEB Russian v1.1 · Classification in Russian MTEB 33.7 #101 of 144v1.1 · STS · Russian Embeddings estimate semantic similarity between pairs on MTEB Russian v1.1 · STS in Russian MTEB 44.9 #89 of 137v1.1 · Retrieval · Russian Embeddings rank relevant documents for queries on MTEB Russian v1.1 · Retrieval in Russian MTEB 24 #52 of 109v1.1 · Mean over tasks · Russian Embeddings assign examples to categories, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, rank relevant documents for queries, assign multiple labels to each example on MTEB Russian v1.1 · mean over tasks in Russian; tasks receive equal weight MTEB 32.3 #60 of 106v1.1 · Mean over task types · Russian Embeddings assign examples to categories, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, rank relevant documents for queries, assign multiple labels to each example on MTEB Russian v1.1 · mean over task types in Russian; task types receive equal weight MTEB 33.3 #59 of 106
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB -2.3 #128 of 191+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB -2.3 #128 of 191Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB -2.3 #128 of 191
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 3.9 #130 of 191+8 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 2.9 #161 of 186v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 41.7 #144 of 182v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 52.8 #140 of 178v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 3.4 #114 of 158v1 · Retrieval · multilingual (14 languages) Embeddings rank relevant documents for queries on MTEB Indic v1 · Retrieval in Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Nepali (individual language), Odia, Panjabi, Sindhi, Tamil, Telugu, Urdu MTEB 14 #99 of 148v1 · Classification · multilingual (8 languages) Embeddings assign examples to categories on MTEB Indic v1 · Classification in Bengali, Gujarati, Hindi, Malayalam, Nepali (macrolanguage), Panjabi, Sanskrit, Urdu MTEB 41.6 #119 of 135v1 · Mean over tasks · multilingual (25 languages) Embeddings assign examples to categories, rank relevant documents for queries, find translated sentence pairs, reorder candidate documents by relevance, classify relationships between pairs, estimate semantic similarity between pairs, group similar examples on MTEB Indic v1 · mean over tasks in 25 languages including Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Dogri (macrolanguage), English, Goan Konkani; tasks receive equal weight MTEB 31.8 #103 of 121v1 · Mean over task types · multilingual (25 languages) Embeddings assign examples to categories, rank relevant documents for queries, find translated sentence pairs, reorder candidate documents by relevance, classify relationships between pairs, estimate semantic similarity between pairs, group similar examples on MTEB Indic v1 · mean over task types in 25 languages including Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Dogri (macrolanguage), English, Goan Konkani; task types receive equal weight MTEB 22.9 #94 of 121
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 20.5 #63 of 191
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 3.3 #166 of 191+1 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 51.4 #148 of 181
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 55 #141 of 187+8 versions & slices v1 · Summarization · French Embeddings match summaries to their source meaning on MTEB French v1 · Summarization in French MTEB 29.5 #107 of 152v1 · Reranking · French Embeddings reorder candidate documents by relevance on MTEB French v1 · Reranking in French MTEB 70 #60 of 138v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB French v1 · Retrieval in English, French MTEB 39.9 #60 of 132v1 · Classification · French Embeddings assign examples to categories on MTEB French v1 · Classification in French MTEB 56 #65 of 131v1 · Clustering · French Embeddings group similar examples on MTEB French v1 · Clustering in French MTEB 43.7 #35 of 119v1 · STS · French Embeddings estimate semantic similarity between pairs on MTEB French v1 · STS in French MTEB 73.8 #40 of 106v1 · Mean over tasks · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, rank relevant documents for queries, reorder candidate documents by relevance, group similar examples, assign examples to categories, match summaries to their source meaning, classify relationships between pairs on MTEB French v1 · mean over tasks in English, French; tasks receive equal weight MTEB 51.5 #37 of 101v1 · Mean over task types · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, rank relevant documents for queries, reorder candidate documents by relevance, group similar examples, assign examples to categories, match summaries to their source meaning, classify relationships between pairs on MTEB French v1 · mean over task types in English, French; task types receive equal weight MTEB 52.6 #39 of 101
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 49.1 #121 of 170+7 versions & slices v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German MTEB 50.8 #87 of 165v1 · Clustering · German Embeddings group similar examples on MTEB German v1 · Clustering in German MTEB 27.6 #60 of 164v1 · Reranking · German Embeddings reorder candidate documents by relevance on MTEB German v1 · Reranking in German MTEB 30.9 #68 of 148v1 · STS · German Embeddings estimate semantic similarity between pairs on MTEB German v1 · STS in German MTEB 53.7 #63 of 128v1 · Retrieval · German Embeddings rank relevant documents for queries on MTEB German v1 · Retrieval in German MTEB 41.1 #42 of 110v1 · Mean over tasks · German Embeddings group similar examples, rank relevant documents for queries, assign examples to categories, estimate semantic similarity between pairs, classify relationships between pairs, reorder candidate documents by relevance on MTEB German v1 · mean over tasks in German; tasks receive equal weight MTEB 43 #42 of 101v1 · Mean over task types · German Embeddings group similar examples, rank relevant documents for queries, assign examples to categories, estimate semantic similarity between pairs, classify relationships between pairs, reorder candidate documents by relevance on MTEB German v1 · mean over task types in German; task types receive equal weight MTEB 42.2 #43 of 101
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 60.3 #97 of 170+3 versions & slices v1 · Reranking · Spanish Embeddings reorder candidate documents by relevance on MTEB Spanish v1 · Reranking in Spanish MTEB 42.5 #67 of 148v1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 42.2 #61 of 127v1 · STS · multilingual (2 languages) Embeddings estimate semantic similarity between pairs on MTEB Spanish v1 · STS in English, Spanish MTEB 67.7 #42 of 76
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 40.1 #73 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 40.1 #73 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 40.1 #73 of 168
JMTEBv2 · STS · Japanese Embeddings estimate semantic similarity between pairs on jMTEB v2 · STS in Japanese MTEB 62.2 #100 of 164+1 versions & slices v2 · Clustering · Japanese Embeddings group similar examples on jMTEB v2 · Clustering in Japanese MTEB 18.5 #102 of 157
MTEB Lawv1 · Mean over tasks · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over tasks in Chinese, English, German; tasks receive equal weight MTEB 39.6 #89 of 163+2 versions & slices v1 · Mean over task types · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over task types in Chinese, English, German; task types receive equal weight MTEB 39.6 #89 of 163v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · Retrieval in Chinese, English, German MTEB 39.6 #89 of 163
MTEB Polishv1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 64 #101 of 153+2 versions & slices v1 · Classification · Polish Embeddings assign examples to categories on MTEB Polish v1 · Classification in Polish MTEB 41.3 #93 of 137v1 · STS · Polish Embeddings estimate semantic similarity between pairs on MTEB Polish v1 · STS in Polish MTEB 56.2 #73 of 122
RTEB Finnish betaMean over tasks · English Embeddings rank relevant documents for queries on RTEB Finnish Beta · mean over tasks in English; tasks receive equal weight MTEB 58.2 #38 of 90
RTEB Health betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 46.1 #50 of 90
BRIGHTMean over tasks · English Embeddings rank relevant documents for queries on BRIGHT · mean over tasks in English; tasks receive equal weight MTEB 13.6 #18 of 28+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BRIGHT · mean over task types in English; task types receive equal weight MTEB 13.6 #18 of 28Retrieval · English Embeddings rank relevant documents for queries on BRIGHT · Retrieval in English MTEB 13.6 #18 of 28
No benchmark matches
Jina Embeddings v3unstatedOpen+22%+400%$0.05Memory (4-bit): 0.2 GB → 0.3 GBcF2LLM v2 14BunstatedOpen+41%——Memory (4-bit): 0.2 GB → 8.4 GBcF2LLM v2 8BunstatedOpen+40%——Memory (4-bit): 0.2 GB → 4.5 GB
Gte Qwen2 7B InstructunstatedOpen+32%——Languages: not verified+1cF2LLM v2 0.6BunstatedOpen+32%——Memory (4-bit): 0.2 GB → 0.4 GB