Benchmark By Score Rank
Retrieval 8
MTEB Englishv2 · Retrieval · English Embeddings rank relevant documents for queries in English MTEB 52.5 #84 of 200
ChemTEBRetrieval · English Embeddings rank relevant documents for queries on cheMTEB · Retrieval in English MTEB 69.9 #33 of 51+6 versions & slices Bitext Mining · English Embeddings find translated sentence pairs on cheMTEB · Bitext Mining in English MTEB 0.3 #15 of 49Clustering · English Embeddings group similar examples on cheMTEB · Clustering in English MTEB 38.5 #32 of 49Pair Classification · multilingual (13 languages) Embeddings classify relationships between pairs on cheMTEB · Pair Classification in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish MTEB 62.5 #11 of 48Classification · English Embeddings assign examples to categories on cheMTEB · Classification in English MTEB 83.4 #13 of 46Mean over tasks · multilingual (13 languages) Embeddings rank relevant documents for queries, group similar examples, assign examples to categories, find translated sentence pairs, classify relationships between pairs on cheMTEB · mean over tasks in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; tasks receive equal weight MTEB 72.1 #13 of 45Mean over task types · multilingual (13 languages) Embeddings rank relevant documents for queries, group similar examples, assign examples to categories, find translated sentence pairs, classify relationships between pairs on cheMTEB · mean over task types in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; task types receive equal weight MTEB 50.9 #20 of 45
Reranking 32
MTEB Medicalv1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 72.1 #71 of 202
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 86.3 #73 of 200+8 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 35.4 #35 of 133v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 35.7 #39 of 133v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 72.5 #57 of 133v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch MTEB 72.7 #58 of 133v1 · Classification · Dutch Embeddings assign examples to categories on MTEB Dutch v1 · Classification in Dutch MTEB 57.8 #55 of 131v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch MTEB 58.7 #32 of 131v1 · Mean over tasks · Dutch Embeddings rank relevant documents for queries, assign examples to categories, assign multiple labels to each example, estimate semantic similarity between pairs, group similar examples, reorder candidate documents by relevance, classify relationships between pairs on MTEB Dutch v1 · mean over tasks in Dutch; tasks receive equal weight MTEB 54.1 #38 of 129v1 · Mean over task types · Dutch Embeddings rank relevant documents for queries, assign examples to categories, assign multiple labels to each example, estimate semantic similarity between pairs, group similar examples, reorder candidate documents by relevance, classify relationships between pairs on MTEB Dutch v1 · mean over task types in Dutch; task types receive equal weight MTEB 59.9 #42 of 129
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB -2.4 #136 of 192+7 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 81.8 #68 of 175v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish MTEB 58 #44 of 175v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 14.5 #62 of 173v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 41.2 #51 of 167v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 85.3 #60 of 154v1 · Retrieval · multilingual (25 languages) Embeddings rank relevant documents for queries on MTEB Europe v1 · Retrieval in 25 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 65.6 #10 of 153v1 · STS · multilingual (8 languages) Embeddings estimate semantic similarity between pairs on MTEB Europe v1 · STS in Dutch, English, Finnish, French, German, Italian, Polish, Spanish MTEB 68.8 #50 of 105
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB -2.4 #136 of 192+10 versions & slices v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali MTEB 65.2 #19 of 176v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 57.9 #69 of 173v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 18.5 #72 of 173v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French MTEB 62 #44 of 173v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French MTEB 76.1 #70 of 166v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian MTEB 44.4 #51 of 160v2 · Classification · multilingual (119 languages) Embeddings assign examples to categories on MTEB Multilingual v2 · Classification in 119 languages including Achinese, Afrikaans, Albanian, Algerian Arabic, Amharic, Arabic, Armenian, Assamese MTEB 53.3 #67 of 154v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 69 #55 of 120v2 · Mean over tasks · multilingual (1037 languages) Embeddings group similar examples, estimate semantic similarity between pairs, assign examples to categories, rank relevant documents for queries, assign multiple labels to each example, find translated sentence pairs, rerank documents according to instructions, reorder candidate documents by relevance, classify relationships between pairs on MTEB Multilingual v2 · mean over tasks in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; tasks receive equal weight MTEB 56 #45 of 91v2 · Mean over task types · multilingual (1037 languages) Embeddings group similar examples, estimate semantic similarity between pairs, assign examples to categories, rank relevant documents for queries, assign multiple labels to each example, find translated sentence pairs, rerank documents according to instructions, reorder candidate documents by relevance, classify relationships between pairs on MTEB Multilingual v2 · mean over task types in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; task types receive equal weight MTEB 49.3 #44 of 91
MTEB Persianv2 · Reranking · Persian Embeddings reorder candidate documents by relevance on MTEB Persian v2 · Reranking in Persian MTEB 70.6 #20 of 149+2 versions & slices v2 · Clustering · Persian Embeddings group similar examples on MTEB Persian v2 · Clustering in Persian MTEB 63.1 #18 of 44v2 · Pair Classification · Persian Embeddings classify relationships between pairs on MTEB Persian v2 · Pair Classification in Persian MTEB 80.9 #28 of 42
Other 38
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 36.6 #73 of 215
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 37.8 #90 of 212
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 40.2 #79 of 209
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 64 #97 of 206
BEIRMean over tasks · English Embeddings rank relevant documents for queries on BEIR · mean over tasks in English; tasks receive equal weight MTEB 49.3 #108 of 196+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BEIR · mean over task types in English; task types receive equal weight MTEB 49.3 #108 of 196Retrieval · English Embeddings rank relevant documents for queries on BEIR · Retrieval in English MTEB 49.3 #108 of 196
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 54 #92 of 194
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 19.7 #90 of 193
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB -2.4 #136 of 192+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB -2.4 #136 of 192Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB -2.4 #136 of 192
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 37.2 #52 of 192+3 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 36 #41 of 187v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 82.9 #55 of 183v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 61.3 #89 of 179
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 44.8 #48 of 192+1 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 62.5 #87 of 182
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 65.1 #28 of 188
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 62.3 #73 of 171
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 71.7 #17 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 71.7 #17 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 71.7 #17 of 168
RTEB Finnish betaMean over tasks · English Embeddings rank relevant documents for queries on RTEB Finnish Beta · mean over tasks in English; tasks receive equal weight MTEB 52.9 #60 of 93
RTEB Health betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 46.9 #49 of 93
MTEB Mandarin Chinesev1 · Pair Classification · Mandarin Chinese Embeddings classify relationships between pairs on MTEB Chinese v1 · Pair Classification in Mandarin Chinese MTEB 60 #71 of 85+3 versions & slices v1 · STS · Mandarin Chinese Embeddings estimate semantic similarity between pairs on MTEB Chinese v1 · STS in Mandarin Chinese MTEB 44.4 #60 of 85v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Chinese v1 · Reranking in Mandarin Chinese MTEB 58.3 #50 of 71v1 · Classification · Mandarin Chinese Embeddings assign examples to categories on MTEB Chinese v1 · Classification in Mandarin Chinese MTEB 64.8 #35 of 55
CoIRMean over tasks · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · mean over tasks in English, c++, go, java, javascript, php, python, ruby, sql; tasks receive equal weight MTEB 62.3 #41 of 62+2 versions & slices Mean over task types · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · mean over task types in English, c++, go, java, javascript, php, python, ruby, sql; task types receive equal weight MTEB 62.3 #41 of 62Retrieval · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · Retrieval in English, c++, go, java, javascript, php, python, ruby, sql MTEB 62.3 #41 of 62
MTEB Codev1 · Mean over tasks · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · mean over tasks in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript; tasks receive equal weight MTEB 63.8 #35 of 56+2 versions & slices v1 · Mean over task types · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · mean over task types in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript; task types receive equal weight MTEB 63.8 #35 of 56v1 · Retrieval · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · Retrieval in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript MTEB 63.8 #35 of 56
BRIGHTMean over tasks · English Embeddings rank relevant documents for queries on BRIGHT · mean over tasks in English; tasks receive equal weight MTEB 11.7 #21 of 28+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BRIGHT · mean over task types in English; task types receive equal weight MTEB 11.7 #21 of 28Retrieval · English Embeddings rank relevant documents for queries on BRIGHT · Retrieval in English MTEB 11.7 #21 of 28
No benchmark matches
BetterEmbeddingGemma 300MunstatedOpen+10%—$0.002Max input: 33K tokens → 2K tokens+1
OpenKaLM Embedding Gemma3 12B 2511+27%——Languages: not verified+1
BetterQwen 3 Embedding 8BunstatedOpen+25%—$0.01Languages: not verified+1
Llama Embed Nemotron 8BOpen+24%——Languages: not verified+1