Benchmark By Score Rank
Retrieval 7
ChemTEBRetrieval · English Embeddings rank relevant documents for queries on cheMTEB · Retrieval in English MTEB 67.9 #35 of 48+6 versions & slices Bitext Mining · English Embeddings find translated sentence pairs on cheMTEB · Bitext Mining in English MTEB 0.2 #16 of 46Classification · English Embeddings assign examples to categories on cheMTEB · Classification in English MTEB 84.5 #10 of 46Clustering · English Embeddings group similar examples on cheMTEB · Clustering in English MTEB 48.9 #15 of 46Mean over tasks · multilingual (13 languages) Embeddings assign examples to categories, rank relevant documents for queries, classify relationships between pairs, group similar examples, find translated sentence pairs on cheMTEB · mean over tasks in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; tasks receive equal weight MTEB 73.2 #7 of 45Mean over task types · multilingual (13 languages) Embeddings assign examples to categories, rank relevant documents for queries, classify relationships between pairs, group similar examples, find translated sentence pairs on cheMTEB · mean over task types in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; task types receive equal weight MTEB 52.5 #12 of 45Pair Classification · multilingual (13 languages) Embeddings classify relationships between pairs on cheMTEB · Pair Classification in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish MTEB 61.1 #11 of 45
Reranking 17
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB -2.4 #134 of 191+3 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 83.7 #59 of 174v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 15.2 #57 of 172v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 44.1 #41 of 166
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB -2.4 #134 of 191+3 versions & slices v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 50.4 #77 of 172v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 19.9 #59 of 172v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian MTEB 46.1 #45 of 159
MTEB Persianv2 · Reranking · Persian Embeddings reorder candidate documents by relevance on MTEB Persian v2 · Reranking in Persian MTEB 57.9 #51 of 149+8 versions & slices v2 · Bitext Mining · Persian Embeddings find translated sentence pairs on MTEB Persian v2 · Bitext Mining in Persian MTEB 51.5 #26 of 40v2 · Clustering · Persian Embeddings group similar examples on MTEB Persian v2 · Clustering in Persian MTEB 57.5 #30 of 40v2 · Pair Classification · Persian Embeddings classify relationships between pairs on MTEB Persian v2 · Pair Classification in Persian MTEB 78.4 #30 of 40v2 · STS · Persian Embeddings estimate semantic similarity between pairs on MTEB Persian v2 · STS in Persian MTEB 69.1 #33 of 39v2 · Classification · Persian Embeddings assign examples to categories on MTEB Persian v2 · Classification in Persian MTEB 61.7 #28 of 35v2 · Mean over tasks · Persian Embeddings estimate semantic similarity between pairs, group similar examples, assign examples to categories, rank relevant documents for queries, reorder candidate documents by relevance, find translated sentence pairs, classify relationships between pairs on MTEB Persian v2 · mean over tasks in Persian; tasks receive equal weight MTEB 54.9 #25 of 33v2 · Mean over task types · Persian Embeddings estimate semantic similarity between pairs, group similar examples, assign examples to categories, rank relevant documents for queries, reorder candidate documents by relevance, find translated sentence pairs, classify relationships between pairs on MTEB Persian v2 · mean over task types in Persian; task types receive equal weight MTEB 59 #25 of 33v2 · Retrieval · Persian Embeddings rank relevant documents for queries on MTEB Persian v2 · Retrieval in Persian MTEB 36.6 #25 of 33
Other 60
MTEB Englishv2 · Classification · English MTEB English v2 · Classification · English: embeddings assign examples to categories in English MTEB 77.6 #95 of 222+4 versions & slices v2 · Summarization · English MTEB English v2 · Summarization · English: embeddings match summaries to their source meaning in English MTEB 32.5 #62 of 208v2 · Clustering · English MTEB English v2 · Clustering · English: embeddings group similar examples in English MTEB 47.5 #80 of 207v2 · STS · English MTEB English v2 · STS · English: embeddings estimate semantic similarity between pairs in English MTEB 81.4 #90 of 200v2 · Retrieval · English MTEB English v2 · Retrieval · English: embeddings rank relevant documents for queries in English MTEB 53.5 #74 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 35.6 #107 of 220+4 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 64.5 #80 of 199v1 · Retrieval · multilingual (10 languages) Embeddings rank relevant documents for queries on MTEB Medical v1 · Retrieval in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese MTEB 59 #30 of 137v1 · Mean over tasks · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over tasks in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; tasks receive equal weight MTEB 55.6 #30 of 135v1 · Mean over task types · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over task types in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; task types receive equal weight MTEB 53.1 #34 of 135
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 44.2 #53 of 212
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 54.8 #48 of 206
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 66.9 #67 of 205+5 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 40.8 #46 of 170v1 · Classification · multilingual (6 languages) Embeddings assign examples to categories on MTEB Scandinavian v1 · Classification in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish MTEB 60.8 #34 of 151v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish MTEB 66.5 #20 of 56v1 · Mean over tasks · multilingual (6 languages) Embeddings group similar examples, assign examples to categories, rank relevant documents for queries, find translated sentence pairs on MTEB Scandinavian v1 · mean over tasks in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; tasks receive equal weight MTEB 58.4 #20 of 47v1 · Mean over task types · multilingual (6 languages) Embeddings group similar examples, assign examples to categories, rank relevant documents for queries, find translated sentence pairs on MTEB Scandinavian v1 · mean over task types in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; task types receive equal weight MTEB 58.7 #22 of 47
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 46.8 #50 of 204
BEIRMean over tasks · English Embeddings rank relevant documents for queries on BEIR · mean over tasks in English; tasks receive equal weight MTEB 51.1 #91 of 194+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BEIR · mean over task types in English; task types receive equal weight MTEB 51.1 #91 of 194Retrieval · English Embeddings rank relevant documents for queries on BEIR · Retrieval in English MTEB 51.1 #91 of 194
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 53.7 #96 of 193+3 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 33.3 #54 of 159v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 52.7 #54 of 155v1.1 · Classification · Russian Embeddings assign examples to categories on MTEB Russian v1.1 · Classification in Russian MTEB 58.3 #53 of 144
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB -2.4 #134 of 191+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB -2.4 #134 of 191Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB -2.4 #134 of 191
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 4.1 #129 of 191+4 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 7.2 #101 of 186v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 62.5 #82 of 178v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 12.2 #62 of 158v1 · Retrieval · multilingual (14 languages) Embeddings rank relevant documents for queries on MTEB Indic v1 · Retrieval in Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Nepali (individual language), Odia, Panjabi, Sindhi, Tamil, Telugu, Urdu MTEB 55.4 #57 of 148
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 22.1 #36 of 191
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 16.7 #104 of 191+1 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 61.2 #93 of 181
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 61.5 #54 of 187+1 versions & slices v1 · Reranking · French Embeddings reorder candidate documents by relevance on MTEB French v1 · Reranking in French MTEB 80.1 #26 of 138
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 54.6 #27 of 170
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 65.8 #56 of 170+7 versions & slices v1 · Reranking · Spanish Embeddings reorder candidate documents by relevance on MTEB Spanish v1 · Reranking in Spanish MTEB 59.3 #33 of 148v1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 49.1 #15 of 127v1 · STS · multilingual (2 languages) Embeddings estimate semantic similarity between pairs on MTEB Spanish v1 · STS in English, Spanish MTEB 79.1 #12 of 76v1 · Classification · Spanish Embeddings assign examples to categories on MTEB Spanish v1 · Classification in Spanish MTEB 89.6 #12 of 27v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Spanish v1 · Retrieval in English, Spanish MTEB 53.5 #9 of 27v1 · Mean over tasks · multilingual (2 languages) Embeddings classify relationships between pairs, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over tasks in English, Spanish; tasks receive equal weight MTEB 65.8 #11 of 26v1 · Mean over task types · multilingual (2 languages) Embeddings classify relationships between pairs, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over task types in English, Spanish; task types receive equal weight MTEB 66.1 #11 of 26
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 53.6 #40 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 53.6 #40 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 53.6 #40 of 168
JMTEBv2 · STS · Japanese Embeddings estimate semantic similarity between pairs on jMTEB v2 · STS in Japanese MTEB 79.5 #48 of 164+1 versions & slices v2 · Clustering · Japanese Embeddings group similar examples on jMTEB v2 · Clustering in Japanese MTEB 50.1 #34 of 157
MTEB Lawv1 · Mean over tasks · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over tasks in Chinese, English, German; tasks receive equal weight MTEB 56.3 #29 of 163+2 versions & slices v1 · Mean over task types · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over task types in Chinese, English, German; task types receive equal weight MTEB 56.3 #29 of 163v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · Retrieval in Chinese, English, German MTEB 56.3 #29 of 163
MTEB Polishv1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 77.7 #58 of 153+1 versions & slices v1 · Classification · Polish Embeddings assign examples to categories on MTEB Polish v1 · Classification in Polish MTEB 57.6 #40 of 137
RTEB Finnish betaMean over tasks · English Embeddings rank relevant documents for queries on RTEB Finnish Beta · mean over tasks in English; tasks receive equal weight MTEB 60.8 #34 of 90
RTEB Health betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 52.3 #40 of 90
No benchmark matches
CheaperQwen 3 Embedding 8BunstatedOpen+28%-50%$0.01
BetterEmbeddingGemma 300MunstatedOpen+17%-90%$0.002Max input: 8K tokens → 2K tokensaOpenGiga Embeddings Instruct 10B A1.8B 0826unstated+35%——