Benchmark By Score Rank
Retrieval 8
MTEB Mandarin Chinesev1 · Retrieval · Mandarin Chinese Embeddings rank relevant documents for queries on MTEB Chinese v1 · Retrieval in Mandarin Chinese MTEB 70 #46 of 86+7 versions & slices v1 · Pair Classification · Mandarin Chinese Embeddings classify relationships between pairs on MTEB Chinese v1 · Pair Classification in Mandarin Chinese MTEB 70.7 #42 of 85v1 · STS · Mandarin Chinese Embeddings estimate semantic similarity between pairs on MTEB Chinese v1 · STS in Mandarin Chinese MTEB 54.8 #30 of 85v1 · Clustering · Mandarin Chinese Embeddings group similar examples on MTEB Chinese v1 · Clustering in Mandarin Chinese MTEB 60.2 #30 of 84v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Chinese v1 · Reranking in Mandarin Chinese MTEB 66.4 #32 of 71v1 · Classification · Mandarin Chinese Embeddings assign examples to categories on MTEB Chinese v1 · Classification in Mandarin Chinese MTEB 63.3 #37 of 55v1 · Mean over tasks · Mandarin Chinese Embeddings estimate semantic similarity between pairs, group similar examples, reorder candidate documents by relevance, rank relevant documents for queries, assign examples to categories, classify relationships between pairs on MTEB Chinese v1 · mean over tasks in Mandarin Chinese; tasks receive equal weight MTEB 63.6 #22 of 35v1 · Mean over task types · Mandarin Chinese Embeddings estimate semantic similarity between pairs, group similar examples, reorder candidate documents by relevance, rank relevant documents for queries, assign examples to categories, classify relationships between pairs on MTEB Chinese v1 · mean over task types in Mandarin Chinese; task types receive equal weight MTEB 64.2 #22 of 35
Reranking 21
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 90.2 #29 of 200+5 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 42.7 #21 of 133v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 30.9 #79 of 133v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 81.2 #13 of 133v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch MTEB 86.1 #7 of 133v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch MTEB 63.1 #17 of 131
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB 1.3 #27 of 192+7 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 90.9 #10 of 175v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish MTEB 60.9 #18 of 175v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 31.8 #2 of 173v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 48.2 #20 of 167v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 91.5 #6 of 154v1 · Retrieval · multilingual (25 languages) Embeddings rank relevant documents for queries on MTEB Europe v1 · Retrieval in 25 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 63.5 #11 of 153v1 · STS · multilingual (8 languages) Embeddings estimate semantic similarity between pairs on MTEB Europe v1 · STS in Dutch, English, Finnish, French, German, Italian, Polish, Spanish MTEB 81.7 #1 of 105
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB 1.3 #27 of 192+6 versions & slices v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali MTEB 64.9 #20 of 176v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 69.7 #36 of 173v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 42 #2 of 173v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French MTEB 65.7 #13 of 173v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian MTEB 53.4 #19 of 160v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 78.8 #8 of 120
Other 60 Leads on 1
MTEB Englishv2 · Pair Classification · English Embeddings classify relationships between pairs in English MTEB 85 #94 of 238+5 versions & slices v2 · Reranking · English Embeddings reorder candidate documents by relevance in English MTEB 49.4 #28 of 223v2 · Summarization · English Embeddings match summaries to their source meaning in English MTEB 31.8 #78 of 209v2 · Clustering · English Embeddings group similar examples in English MTEB 54.7 #36 of 207v2 · STS · English Embeddings estimate semantic similarity between pairs in English MTEB 88.1 #7 of 200v2 · Retrieval · English Embeddings rank relevant documents for queries in English MTEB 60.1 #21 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 42.5 #35 of 220+1 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 83.4 #37 of 202
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 51.3 #34 of 215
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 63.6 #31 of 212
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 56.4 #30 of 209
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 86 #1 of 206+2 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 51.9 #6 of 175v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish MTEB 68 #21 of 144
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 67.3 #8 of 194+2 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 41.7 #22 of 162v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 61.3 #23 of 158
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 21.3 #49 of 193
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB 1.3 #27 of 192+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB 1.3 #27 of 192Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB 1.3 #27 of 192
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 47.8 #32 of 192+4 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 48.1 #22 of 187v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 87 #18 of 183v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 79.8 #17 of 179v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 70.5 #24 of 162
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 55.2 #25 of 192+2 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 79.2 #21 of 182v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Thai v1 · Retrieval in English, Thai MTEB 64.6 #6 of 27
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 58.6 #9 of 175+4 versions & slices v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German MTEB 86.4 #6 of 168v1 · Clustering · German Embeddings group similar examples on MTEB German v1 · Clustering in German MTEB 41.3 #5 of 167v1 · Reranking · German Embeddings reorder candidate documents by relevance on MTEB German v1 · Reranking in German MTEB 54.9 #4 of 148v1 · Retrieval · German Embeddings rank relevant documents for queries on MTEB German v1 · Retrieval in German MTEB 57.3 #8 of 127
JMTEBv2 · STS · Japanese Embeddings estimate semantic similarity between pairs on jMTEB v2 · STS in Japanese MTEB 82.5 #28 of 168+1 versions & slices v2 · Clustering · Japanese Embeddings group similar examples on jMTEB v2 · Clustering in Japanese MTEB 51.8 #28 of 161
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 66.4 #23 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 66.4 #23 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 66.4 #23 of 168
MTEB Polishv1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 86.9 #10 of 159+1 versions & slices v1 · Clustering · Polish Embeddings group similar examples on MTEB Polish v1 · Clustering in Polish MTEB 49.5 #4 of 121
MTEB Frenchv1 · Summarization · French Embeddings match summaries to their source meaning on MTEB French v1 · Summarization in French MTEB 29 #128 of 158+1 versions & slices v1 · Reranking · French Embeddings reorder candidate documents by relevance on MTEB French v1 · Reranking in French MTEB 86.5 #6 of 144
MTEB Koreanv2 · Classification · Korean Embeddings assign examples to categories on MTEB Korean v2 · Classification in Korean MTEB 33.3 #68 of 156+2 versions & slices v2 · STS · Korean Embeddings estimate semantic similarity between pairs on MTEB Korean v2 · STS in Korean MTEB 87.5 #4 of 108v2 · Clustering · Korean Embeddings group similar examples on MTEB Korean v2 · Clustering in Korean MTEB 74.4 #6 of 40
MTEB Spanishv1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 48.8 #18 of 127+3 versions & slices v1 · Classification · Spanish Embeddings assign examples to categories on MTEB Spanish v1 · Classification in Spanish MTEB 80.3 #40 of 101v1 · STS · multilingual (2 languages) Embeddings estimate semantic similarity between pairs on MTEB Spanish v1 · STS in English, Spanish MTEB 82.5 #3 of 88v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Spanish v1 · Retrieval in English, Spanish MTEB 56.7 #6 of 28
RTEB Finnish betaMean over tasks · English Embeddings rank relevant documents for queries on RTEB Finnish Beta · mean over tasks in English; tasks receive equal weight MTEB 66.1 #31 of 93
RTEB Health betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 62.3 #23 of 93
MTEB Persianv2 · Bitext Mining · Persian Embeddings find translated sentence pairs on MTEB Persian v2 · Bitext Mining in Persian MTEB 57.4 #23 of 44+3 versions & slices v2 · Clustering · Persian Embeddings group similar examples on MTEB Persian v2 · Clustering in Persian MTEB 69.5 #2 of 44v2 · STS · Persian Embeddings estimate semantic similarity between pairs on MTEB Persian v2 · STS in Persian MTEB 80 #9 of 43v2 · Pair Classification · Persian Embeddings classify relationships between pairs on MTEB Persian v2 · Pair Classification in Persian MTEB 83.4 #15 of 42
VN-MTEB Vietnamesev1 · Clustering · Vietnamese Embeddings group similar examples on Vn MTEB Vietnamese v1 · Clustering in Vietnamese MTEB 52.7 #7 of 32+3 versions & slices v1 · Reranking · Vietnamese Embeddings reorder candidate documents by relevance on Vn MTEB Vietnamese v1 · Reranking in Vietnamese MTEB 67.5 #5 of 32v1 · STS · Vietnamese Embeddings estimate semantic similarity between pairs on Vn MTEB Vietnamese v1 · STS in Vietnamese MTEB 85.9 #1 of 32v1 · Pair Classification · Vietnamese Embeddings classify relationships between pairs on Vn MTEB Vietnamese v1 · Pair Classification in Vietnamese MTEB 84.6 #6 of 28
No benchmark matches
CheaperQwen 3 Embedding 8BunstatedOpen+19%-80%$0.01Memory (4-bit): 0.4 GB → 4.5 GBOOpenOcten Embedding 8B+37%——Memory (4-bit): 0.4 GB → 4.5 GB
CheaperNemotron 3 Embed 1B BF16Open+9%-70%$0.015Memory (4-bit): 0.4 GB → 0.7 GBVCheaperVoyage 4 Lite+2%-60%$0.02Max input: 33K tokens → 32K tokens