Benchmark By Score Rank
Retrieval 10
MTEB Mandarin Chinesev1 · Retrieval · Mandarin Chinese Embeddings rank relevant documents for queries on MTEB Chinese v1 · Retrieval in Mandarin Chinese MTEB 4.4 #82 of 83+2 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Chinese v1 · Reranking in Mandarin Chinese MTEB 25.1 #70 of 71v1 · Classification · Mandarin Chinese Embeddings assign examples to categories on MTEB Chinese v1 · Classification in Mandarin Chinese MTEB 43.3 #39 of 52
ChemTEBRetrieval · English Embeddings rank relevant documents for queries on cheMTEB · Retrieval in English MTEB 60.7 #44 of 48+6 versions & slices Bitext Mining · English Embeddings find translated sentence pairs on cheMTEB · Bitext Mining in English MTEB 0.1 #42 of 46Classification · English Embeddings assign examples to categories on cheMTEB · Classification in English MTEB 82.2 #18 of 46Clustering · English Embeddings group similar examples on cheMTEB · Clustering in English MTEB 50.5 #10 of 46Mean over tasks · multilingual (13 languages) Embeddings assign examples to categories, rank relevant documents for queries, classify relationships between pairs, group similar examples, find translated sentence pairs on cheMTEB · mean over tasks in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; tasks receive equal weight MTEB 69.8 #24 of 45Mean over task types · multilingual (13 languages) Embeddings assign examples to categories, rank relevant documents for queries, classify relationships between pairs, group similar examples, find translated sentence pairs on cheMTEB · mean over task types in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; task types receive equal weight MTEB 49.3 #28 of 45Pair Classification · multilingual (13 languages) Embeddings classify relationships between pairs on cheMTEB · Pair Classification in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish MTEB 52.9 #41 of 45
Reranking 23
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 73.9 #155 of 199+8 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 21.6 #93 of 133v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 28 #103 of 133v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 57.9 #127 of 133v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch MTEB 57 #103 of 133v1 · Classification · Dutch Embeddings assign examples to categories on MTEB Dutch v1 · Classification in Dutch MTEB 46 #96 of 131v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch MTEB 29.2 #99 of 131v1 · Mean over tasks · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over tasks in Dutch; tasks receive equal weight MTEB 36.6 #97 of 129v1 · Mean over task types · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over task types in Dutch; task types receive equal weight MTEB 44.8 #99 of 129
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB -3.1 #159 of 191+4 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 29.9 #140 of 174v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 10.9 #118 of 172v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 80.5 #107 of 141v1 · STS · multilingual (8 languages) Embeddings estimate semantic similarity between pairs on MTEB Europe v1 · STS in Dutch, English, Finnish, French, German, Italian, Polish, Spanish MTEB 63.9 #55 of 85
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB -3.1 #159 of 191+3 versions & slices v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 21.2 #140 of 172v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 16.3 #106 of 172v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 57.6 #81 of 112
MTEB Koreanv2 · Reranking · Korean Embeddings reorder candidate documents by relevance on MTEB Korean v2 · Reranking in Korean MTEB 5.9 #128 of 150+2 versions & slices v2 · Classification · Korean Embeddings assign examples to categories on MTEB Korean v2 · Classification in Korean MTEB 23.2 #77 of 147v2 · STS · Korean Embeddings estimate semantic similarity between pairs on MTEB Korean v2 · STS in Korean MTEB 33.7 #71 of 92
MTEB Spanishv1 · Reranking · Spanish Embeddings reorder candidate documents by relevance on MTEB Spanish v1 · Reranking in Spanish MTEB 26.5 #105 of 148+1 versions & slices v1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 39.5 #86 of 127
Other 67
MTEB Englishv2 · Pair Classification · English Embeddings classify relationships between pairs in English MTEB 83 #144 of 238+5 versions & slices v2 · Reranking · English Embeddings reorder candidate documents by relevance in English MTEB 48.4 #50 of 223v2 · Summarization · English Embeddings match summaries to their source meaning in English MTEB 23.7 #187 of 208v2 · Clustering · English Embeddings group similar examples in English MTEB 46.6 #92 of 207v2 · STS · English Embeddings estimate semantic similarity between pairs in English MTEB 80.4 #109 of 200v2 · Retrieval · English Embeddings rank relevant documents for queries in English MTEB 44.5 #130 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 38.4 #54 of 220+4 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 18.8 #140 of 199v1 · Retrieval · multilingual (10 languages) Embeddings rank relevant documents for queries on MTEB Medical v1 · Retrieval in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese MTEB 33 #94 of 137v1 · Mean over tasks · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over tasks in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; tasks receive equal weight MTEB 32.7 #93 of 135v1 · Mean over task types · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over task types in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; task types receive equal weight MTEB 30.1 #91 of 135
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 12.6 #152 of 212
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 10.7 #172 of 206
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 58.6 #140 of 205+2 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 32.3 #104 of 170v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish MTEB 33 #48 of 56
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 28.3 #151 of 204
BEIRMean over tasks · English Embeddings rank relevant documents for queries on BEIR · mean over tasks in English; tasks receive equal weight MTEB 43.8 #134 of 194+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BEIR · mean over task types in English; task types receive equal weight MTEB 43.8 #134 of 194Retrieval · English Embeddings rank relevant documents for queries on BEIR · Retrieval in English MTEB 43.8 #134 of 194
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 44.5 #189 of 193+4 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 26.9 #98 of 159v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 15.8 #121 of 155v1.1 · Reranking · Russian Embeddings reorder candidate documents by relevance on MTEB Russian v1.1 · Reranking in Russian MTEB 20.4 #119 of 153v1.1 · Classification · Russian Embeddings assign examples to categories on MTEB Russian v1.1 · Classification in Russian MTEB 28.8 #121 of 144
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB -3.1 #159 of 191+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB -3.1 #159 of 191Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB -3.1 #159 of 191
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB -2.5 #181 of 191+3 versions & slices v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 52.6 #141 of 178v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 3.7 #108 of 158v1 · Retrieval · multilingual (14 languages) Embeddings rank relevant documents for queries on MTEB Indic v1 · Retrieval in Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Nepali (individual language), Odia, Panjabi, Sindhi, Tamil, Telugu, Urdu MTEB 12.9 #108 of 148
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 18.4 #130 of 191+1 versions & slices v1 · Classification · Portuguese Embeddings assign examples to categories on MTEB Portuguese v1 · Classification in Portuguese MTEB 47.1 #27 of 27
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 3.3 #164 of 191+6 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 51.1 #161 of 181v1 · Classification · Thai Embeddings assign examples to categories on MTEB Thai v1 · Classification in Thai MTEB 16.7 #30 of 32v1 · Reranking · Thai Embeddings reorder candidate documents by relevance on MTEB Thai v1 · Reranking in Thai MTEB 5.6 #28 of 29v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Thai v1 · Retrieval in English, Thai MTEB 7.2 #26 of 27v1 · Mean over tasks · multilingual (2 languages) Embeddings group similar examples, assign examples to categories, classify relationships between pairs, rank relevant documents for queries, reorder candidate documents by relevance on MTEB Thai v1 · mean over tasks in English, Thai; tasks receive equal weight MTEB 12.2 #25 of 26v1 · Mean over task types · multilingual (2 languages) Embeddings group similar examples, assign examples to categories, classify relationships between pairs, rank relevant documents for queries, reorder candidate documents by relevance on MTEB Thai v1 · mean over task types in English, Thai; task types receive equal weight MTEB 16.8 #25 of 26
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 49 #125 of 170+7 versions & slices v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German MTEB 49.1 #99 of 165v1 · Clustering · German Embeddings group similar examples on MTEB German v1 · Clustering in German MTEB 23.8 #93 of 164v1 · Reranking · German Embeddings reorder candidate documents by relevance on MTEB German v1 · Reranking in German MTEB 23.4 #90 of 148v1 · STS · German Embeddings estimate semantic similarity between pairs on MTEB German v1 · STS in German MTEB 45.8 #101 of 128v1 · Retrieval · German Embeddings rank relevant documents for queries on MTEB German v1 · Retrieval in German MTEB 34.4 #71 of 110v1 · Mean over tasks · German Embeddings group similar examples, rank relevant documents for queries, assign examples to categories, estimate semantic similarity between pairs, classify relationships between pairs, reorder candidate documents by relevance on MTEB German v1 · mean over tasks in German; tasks receive equal weight MTEB 39 #64 of 101v1 · Mean over task types · German Embeddings group similar examples, rank relevant documents for queries, assign examples to categories, estimate semantic similarity between pairs, classify relationships between pairs, reorder candidate documents by relevance on MTEB German v1 · mean over task types in German; task types receive equal weight MTEB 37.6 #65 of 101
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 31.1 #119 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 31.1 #119 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 31.1 #119 of 168
JMTEBv2 · STS · Japanese Embeddings estimate semantic similarity between pairs on jMTEB v2 · STS in Japanese MTEB 67.1 #75 of 164
MTEB Lawv1 · Mean over tasks · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over tasks in Chinese, English, German; tasks receive equal weight MTEB 37.4 #107 of 163+2 versions & slices v1 · Mean over task types · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over task types in Chinese, English, German; task types receive equal weight MTEB 37.4 #107 of 163v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · Retrieval in Chinese, English, German MTEB 37.4 #107 of 163
MTEB Polishv1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 60.5 #132 of 153+1 versions & slices v1 · Classification · Polish Embeddings assign examples to categories on MTEB Polish v1 · Classification in Polish MTEB 39.7 #115 of 137
MTEB Frenchv1 · Summarization · French Embeddings match summaries to their source meaning on MTEB French v1 · Summarization in French MTEB 28.1 #139 of 152+3 versions & slices v1 · Reranking · French Embeddings reorder candidate documents by relevance on MTEB French v1 · Reranking in French MTEB 67.9 #73 of 138v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB French v1 · Retrieval in English, French MTEB 34.8 #79 of 132v1 · Clustering · French Embeddings group similar examples on MTEB French v1 · Clustering in French MTEB 42.3 #45 of 119
RTEB Finnish betaMean over tasks · English Embeddings rank relevant documents for queries on RTEB Finnish Beta · mean over tasks in English; tasks receive equal weight MTEB 55.9 #47 of 90
RTEB Health betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 37.7 #66 of 90
BRIGHTMean over tasks · English Embeddings rank relevant documents for queries on BRIGHT · mean over tasks in English; tasks receive equal weight MTEB 14.6 #17 of 28+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BRIGHT · mean over task types in English; task types receive equal weight MTEB 14.6 #17 of 28Retrieval · English Embeddings rank relevant documents for queries on BRIGHT · Retrieval in English MTEB 14.6 #17 of 28
No benchmark matches
OpenGte Qwen2 7B Instructunstated×2.3——Languages: not verified+1tBetterGte BaseunstatedOpen+12%same$0.005tBetterGte LargeunstatedOpen+15%+100%$0.01Memory (4-bit): 0.1 GB → 0.2 GBiBetterE5 Large v2unstatedOpen+13%+100%$0.01Memory (4-bit): 0.1 GB → 0.2 GB