Benchmark By Score Rank
Retrieval 15
MTEB Mandarin Chinesev1 · Retrieval · Mandarin Chinese Embeddings rank relevant documents for queries on MTEB Chinese v1 · Retrieval in Mandarin Chinese MTEB 63.7 #56 of 83+7 versions & slices v1 · Pair Classification · Mandarin Chinese Embeddings classify relationships between pairs on MTEB Chinese v1 · Pair Classification in Mandarin Chinese MTEB 64.2 #56 of 81v1 · STS · Mandarin Chinese Embeddings estimate semantic similarity between pairs on MTEB Chinese v1 · STS in Mandarin Chinese MTEB 45.5 #54 of 81v1 · Clustering · Mandarin Chinese Embeddings group similar examples on MTEB Chinese v1 · Clustering in Mandarin Chinese MTEB 46.6 #53 of 80v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Chinese v1 · Reranking in Mandarin Chinese MTEB 57.5 #51 of 71v1 · Classification · Mandarin Chinese Embeddings assign examples to categories on MTEB Chinese v1 · Classification in Mandarin Chinese MTEB 69.8 #27 of 52v1 · Mean over tasks · Mandarin Chinese Embeddings rank relevant documents for queries, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, assign examples to categories on MTEB Chinese v1 · mean over tasks in Mandarin Chinese; tasks receive equal weight MTEB 57.8 #25 of 31v1 · Mean over task types · Mandarin Chinese Embeddings rank relevant documents for queries, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, assign examples to categories on MTEB Chinese v1 · mean over task types in Mandarin Chinese; task types receive equal weight MTEB 57.9 #25 of 31
ChemTEBRetrieval · English Embeddings rank relevant documents for queries on cheMTEB · Retrieval in English MTEB 73 #21 of 48+6 versions & slices Bitext Mining · English Embeddings find translated sentence pairs on cheMTEB · Bitext Mining in English MTEB 0.2 #23 of 46Classification · English Embeddings assign examples to categories on cheMTEB · Classification in English MTEB 79.2 #39 of 46Clustering · English Embeddings group similar examples on cheMTEB · Clustering in English MTEB 32.9 #38 of 46Mean over tasks · multilingual (13 languages) Embeddings assign examples to categories, rank relevant documents for queries, classify relationships between pairs, group similar examples, find translated sentence pairs on cheMTEB · mean over tasks in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; tasks receive equal weight MTEB 68.3 #37 of 45Mean over task types · multilingual (13 languages) Embeddings assign examples to categories, rank relevant documents for queries, classify relationships between pairs, group similar examples, find translated sentence pairs on cheMTEB · mean over task types in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; task types receive equal weight MTEB 48.5 #33 of 45Pair Classification · multilingual (13 languages) Embeddings classify relationships between pairs on cheMTEB · Pair Classification in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish MTEB 57 #22 of 45
Reranking 28
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 90.3 #28 of 199+8 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 29 #54 of 133v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 35.9 #38 of 133v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 80.3 #19 of 133v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch MTEB 80.1 #24 of 133v1 · Classification · Dutch Embeddings assign examples to categories on MTEB Dutch v1 · Classification in Dutch MTEB 60.6 #36 of 131v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch MTEB 59 #30 of 131v1 · Mean over tasks · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over tasks in Dutch; tasks receive equal weight MTEB 54.7 #35 of 129v1 · Mean over task types · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over task types in Dutch; task types receive equal weight MTEB 62.2 #28 of 129
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB -3.1 #158 of 191+4 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 88 #32 of 174v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 14.6 #61 of 172v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 88.8 #27 of 141v1 · STS · multilingual (8 languages) Embeddings estimate semantic similarity between pairs on MTEB Europe v1 · STS in Dutch, English, Finnish, French, German, Italian, Polish, Spanish MTEB 75.6 #10 of 85
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB -3.1 #158 of 191+1 versions & slices v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 20.4 #53 of 172
MTEB Koreanv2 · Reranking · Korean Embeddings reorder candidate documents by relevance on MTEB Korean v2 · Reranking in Korean MTEB 55.3 #30 of 150+2 versions & slices v2 · Classification · Korean Embeddings assign examples to categories on MTEB Korean v2 · Classification in Korean MTEB 60.8 #20 of 147v2 · STS · Korean Embeddings estimate semantic similarity between pairs on MTEB Korean v2 · STS in Korean MTEB 82.1 #18 of 92
MTEB Persianv2 · Reranking · Persian Embeddings reorder candidate documents by relevance on MTEB Persian v2 · Reranking in Persian MTEB 74.3 #3 of 149+8 versions & slices v2 · Bitext Mining · Persian Embeddings find translated sentence pairs on MTEB Persian v2 · Bitext Mining in Persian MTEB 56.6 #21 of 40v2 · Clustering · Persian Embeddings group similar examples on MTEB Persian v2 · Clustering in Persian MTEB 57.2 #33 of 40v2 · Pair Classification · Persian Embeddings classify relationships between pairs on MTEB Persian v2 · Pair Classification in Persian MTEB 82.3 #18 of 40v2 · STS · Persian Embeddings estimate semantic similarity between pairs on MTEB Persian v2 · STS in Persian MTEB 79.3 #9 of 39v2 · Classification · Persian Embeddings assign examples to categories on MTEB Persian v2 · Classification in Persian MTEB 65.7 #18 of 35v2 · Mean over tasks · Persian Embeddings estimate semantic similarity between pairs, group similar examples, assign examples to categories, rank relevant documents for queries, reorder candidate documents by relevance, find translated sentence pairs, classify relationships between pairs on MTEB Persian v2 · mean over tasks in Persian; tasks receive equal weight MTEB 64.3 #13 of 33v2 · Mean over task types · Persian Embeddings estimate semantic similarity between pairs, group similar examples, assign examples to categories, rank relevant documents for queries, reorder candidate documents by relevance, find translated sentence pairs, classify relationships between pairs on MTEB Persian v2 · mean over task types in Persian; task types receive equal weight MTEB 67.4 #14 of 33v2 · Retrieval · Persian Embeddings rank relevant documents for queries on MTEB Persian v2 · Retrieval in Persian MTEB 56 #11 of 33
Other 76
MTEB Englishv2 · Pair Classification · English Embeddings classify relationships between pairs in English MTEB 84.7 #104 of 238+5 versions & slices v2 · Reranking · English Embeddings reorder candidate documents by relevance in English MTEB 44.7 #162 of 223v2 · Summarization · English Embeddings match summaries to their source meaning in English MTEB 31.4 #79 of 208v2 · Clustering · English Embeddings group similar examples in English MTEB 42.1 #149 of 207v2 · STS · English Embeddings estimate semantic similarity between pairs in English MTEB 81.4 #89 of 200v2 · Retrieval · English Embeddings rank relevant documents for queries in English MTEB 51.5 #94 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 32.9 #155 of 220+1 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 66.8 #77 of 199
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 47 #46 of 212
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 43.2 #76 of 206
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 69.1 #50 of 205+2 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 41.8 #32 of 170v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish MTEB 64.5 #25 of 56
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 38.1 #82 of 204
BEIRMean over tasks · English Embeddings rank relevant documents for queries on BEIR · mean over tasks in English; tasks receive equal weight MTEB 51.5 #83 of 194+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BEIR · mean over task types in English; task types receive equal weight MTEB 51.5 #83 of 194Retrieval · English Embeddings rank relevant documents for queries on BEIR · Retrieval in English MTEB 51.5 #83 of 194
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 58.4 #52 of 193+4 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 36 #44 of 159v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 52.2 #57 of 155v1.1 · Reranking · Russian Embeddings reorder candidate documents by relevance on MTEB Russian v1.1 · Reranking in Russian MTEB 69.7 #15 of 153v1.1 · Classification · Russian Embeddings assign examples to categories on MTEB Russian v1.1 · Classification in Russian MTEB 60.9 #42 of 144
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB -3.1 #158 of 191+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB -3.1 #158 of 191Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB -3.1 #158 of 191
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 43.9 #40 of 191+3 versions & slices v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 75.1 #32 of 178v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 77.7 #6 of 158v1 · Retrieval · multilingual (14 languages) Embeddings rank relevant documents for queries on MTEB Indic v1 · Retrieval in Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Nepali (individual language), Odia, Panjabi, Sindhi, Tamil, Telugu, Urdu MTEB 82.6 #14 of 148
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 17.7 #146 of 191+6 versions & slices v1 · Classification · Portuguese Embeddings assign examples to categories on MTEB Portuguese v1 · Classification in Portuguese MTEB 59.3 #9 of 27v1 · Retrieval · Portuguese Embeddings rank relevant documents for queries on MTEB Portuguese v1 · Retrieval in Portuguese MTEB 74.5 #7 of 22v1 · Mean over tasks · Portuguese Embeddings assign examples to categories, rank relevant documents for queries, assign multiple labels to each example, estimate semantic similarity between pairs, reorder candidate documents by relevance on MTEB Portuguese v1 · mean over tasks in Portuguese; tasks receive equal weight MTEB 69.2 #6 of 20v1 · Mean over task types · Portuguese Embeddings assign examples to categories, rank relevant documents for queries, assign multiple labels to each example, estimate semantic similarity between pairs, reorder candidate documents by relevance on MTEB Portuguese v1 · mean over task types in Portuguese; task types receive equal weight MTEB 63 #7 of 20v1 · Reranking · Portuguese Embeddings reorder candidate documents by relevance on MTEB Portuguese v1 · Reranking in Portuguese MTEB 84.2 #6 of 20v1 · STS · Portuguese Embeddings estimate semantic similarity between pairs on MTEB Portuguese v1 · STS in Portuguese MTEB 79.2 #10 of 20
MTEB Thaiv1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 71 #49 of 181
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 54.1 #31 of 170+7 versions & slices v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German MTEB 67.5 #33 of 165v1 · Clustering · German Embeddings group similar examples on MTEB German v1 · Clustering in German MTEB 33.5 #28 of 164v1 · Reranking · German Embeddings reorder candidate documents by relevance on MTEB German v1 · Reranking in German MTEB 53.6 #11 of 148v1 · STS · German Embeddings estimate semantic similarity between pairs on MTEB German v1 · STS in German MTEB 71.6 #16 of 128v1 · Retrieval · German Embeddings rank relevant documents for queries on MTEB German v1 · Retrieval in German MTEB 50 #23 of 110v1 · Mean over tasks · German Embeddings group similar examples, rank relevant documents for queries, assign examples to categories, estimate semantic similarity between pairs, classify relationships between pairs, reorder candidate documents by relevance on MTEB German v1 · mean over tasks in German; tasks receive equal weight MTEB 54.9 #17 of 101v1 · Mean over task types · German Embeddings group similar examples, rank relevant documents for queries, assign examples to categories, estimate semantic similarity between pairs, classify relationships between pairs, reorder candidate documents by relevance on MTEB German v1 · mean over task types in German; task types receive equal weight MTEB 55 #14 of 101
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 65.2 #59 of 170+7 versions & slices v1 · Reranking · Spanish Embeddings reorder candidate documents by relevance on MTEB Spanish v1 · Reranking in Spanish MTEB 61.7 #17 of 148v1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 46.6 #25 of 127v1 · STS · multilingual (2 languages) Embeddings estimate semantic similarity between pairs on MTEB Spanish v1 · STS in English, Spanish MTEB 79.3 #9 of 76v1 · Classification · Spanish Embeddings assign examples to categories on MTEB Spanish v1 · Classification in Spanish MTEB 90.5 #10 of 27v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Spanish v1 · Retrieval in English, Spanish MTEB 50.5 #12 of 27v1 · Mean over tasks · multilingual (2 languages) Embeddings classify relationships between pairs, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over tasks in English, Spanish; tasks receive equal weight MTEB 64.7 #13 of 26v1 · Mean over task types · multilingual (2 languages) Embeddings classify relationships between pairs, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over task types in English, Spanish; task types receive equal weight MTEB 65.6 #14 of 26
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 40.4 #68 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 40.4 #68 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 40.4 #68 of 168
JMTEBv2 · STS · Japanese Embeddings estimate semantic similarity between pairs on jMTEB v2 · STS in Japanese MTEB 80.8 #32 of 164
MTEB Lawv1 · Mean over tasks · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over tasks in Chinese, English, German; tasks receive equal weight MTEB 48.4 #54 of 163+2 versions & slices v1 · Mean over task types · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over task types in Chinese, English, German; task types receive equal weight MTEB 48.4 #54 of 163v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · Retrieval in Chinese, English, German MTEB 48.4 #54 of 163
MTEB Polishv1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 85.3 #21 of 153+1 versions & slices v1 · Classification · Polish Embeddings assign examples to categories on MTEB Polish v1 · Classification in Polish MTEB 61 #29 of 137
MTEB Frenchv1 · Summarization · French Embeddings match summaries to their source meaning on MTEB French v1 · Summarization in French MTEB 30.9 #39 of 152+1 versions & slices v1 · Reranking · French Embeddings reorder candidate documents by relevance on MTEB French v1 · Reranking in French MTEB 77.4 #34 of 138
RTEB Health betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 54.2 #38 of 90
VN-MTEB Vietnamesev1 · Clustering · Vietnamese Embeddings group similar examples on Vn MTEB Vietnamese v1 · Clustering in Vietnamese MTEB 45.8 #14 of 31+7 versions & slices v1 · Reranking · Vietnamese Embeddings reorder candidate documents by relevance on Vn MTEB Vietnamese v1 · Reranking in Vietnamese MTEB 64.1 #14 of 31v1 · STS · Vietnamese Embeddings estimate semantic similarity between pairs on Vn MTEB Vietnamese v1 · STS in Vietnamese MTEB 80.6 #10 of 31v1 · Classification · Vietnamese Embeddings assign examples to categories on Vn MTEB Vietnamese v1 · Classification in Vietnamese MTEB 63.1 #16 of 30v1 · Retrieval · Vietnamese Embeddings rank relevant documents for queries on Vn MTEB Vietnamese v1 · Retrieval in Vietnamese MTEB 37.6 #12 of 29v1 · Pair Classification · Vietnamese Embeddings classify relationships between pairs on Vn MTEB Vietnamese v1 · Pair Classification in Vietnamese MTEB 83.9 #10 of 27v1 · Mean over tasks · Vietnamese Embeddings assign examples to categories, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, classify relationships between pairs on Vn MTEB Vietnamese v1 · mean over tasks in Vietnamese; tasks receive equal weight MTEB 51.5 #11 of 26v1 · Mean over task types · Vietnamese Embeddings assign examples to categories, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, classify relationships between pairs on Vn MTEB Vietnamese v1 · mean over task types in Vietnamese; task types receive equal weight MTEB 62.5 #10 of 26
BEIR-NLMean over tasks · Dutch Embeddings rank relevant documents for queries on BEIR NL · mean over tasks in Dutch; tasks receive equal weight MTEB 45.9 #3 of 15+2 versions & slices Mean over task types · Dutch Embeddings rank relevant documents for queries on BEIR NL · mean over task types in Dutch; task types receive equal weight MTEB 45.9 #3 of 15Retrieval · Dutch Embeddings rank relevant documents for queries on BEIR NL · Retrieval in Dutch MTEB 45.9 #3 of 15
No benchmark matches
BetterJina Embeddings v5 Text NanounstatedOpen+3%+100%$0.02Languages: not verifiedcOpenF2LLM v2 8Bunstated+13%——Languages: loses Assamese, Western Frisian, Scottish Gaelic +12+1
BetterText Embedding 3 Largeunstated+6%+1,200%$0.13Languages: not verified
BetterGemini Embedding 001unstated+11%+1,400%$0.15Languages: not verifiedcBetterF2LLM v2 14BunstatedOpen+13%——Languages: loses Assamese, Western Frisian, Scottish Gaelic +12+1