Benchmark By Score Rank
Reranking 1
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 87.7 #57 of 199
Other 43
MTEB Englishv2 · Pair Classification · English MTEB English v2 · Pair Classification · English: embeddings classify relationships between pairs in English MTEB 91.3 #4 of 238+5 versions & slices v2 · Reranking · English MTEB English v2 · Reranking · English: embeddings reorder candidate documents by relevance in English MTEB 50.1 #14 of 223v2 · Classification · English MTEB English v2 · Classification · English: embeddings assign examples to categories in English MTEB 81.7 #60 of 222v2 · Summarization · English MTEB English v2 · Summarization · English: embeddings match summaries to their source meaning in English MTEB 34.3 #32 of 208v2 · Clustering · English MTEB English v2 · Clustering · English: embeddings group similar examples in English MTEB 50 #52 of 207v2 · STS · English MTEB English v2 · STS · English: embeddings estimate semantic similarity between pairs in English MTEB 82.8 #55 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 39.3 #50 of 220+1 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 79.6 #44 of 199
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 34.2 #76 of 212
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 62.3 #113 of 205+5 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 43.3 #22 of 170v1 · Classification · multilingual (6 languages) Embeddings assign examples to categories on MTEB Scandinavian v1 · Classification in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish MTEB 61.7 #28 of 151v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish MTEB 69.2 #15 of 56v1 · Mean over tasks · multilingual (6 languages) Embeddings group similar examples, assign examples to categories, rank relevant documents for queries, find translated sentence pairs on MTEB Scandinavian v1 · mean over tasks in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; tasks receive equal weight MTEB 59.7 #18 of 47v1 · Mean over task types · multilingual (6 languages) Embeddings group similar examples, assign examples to categories, rank relevant documents for queries, find translated sentence pairs on MTEB Scandinavian v1 · mean over task types in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; task types receive equal weight MTEB 59.1 #19 of 47
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 56.4 #69 of 193+3 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 38.6 #33 of 159v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 57.6 #30 of 155v1.1 · Classification · Russian Embeddings assign examples to categories on MTEB Russian v1.1 · Classification in Russian MTEB 63.8 #31 of 144
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 6.9 #112 of 191+4 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 12.4 #95 of 186v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 73.1 #85 of 182v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 59.4 #95 of 178v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 13.8 #60 of 158
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 17.2 #157 of 191
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 27.3 #93 of 191+1 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 60.3 #94 of 181
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 64.3 #35 of 187
MTEB Europev1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 78.2 #79 of 174+2 versions & slices v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 87 #41 of 141v1 · STS · multilingual (8 languages) Embeddings estimate semantic similarity between pairs on MTEB Europe v1 · STS in Dutch, English, Finnish, French, German, Italian, Polish, Spanish MTEB 74 #18 of 85
MTEB multilingualv2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 46.8 #81 of 172+2 versions & slices v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French MTEB 77.8 #53 of 165v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 70.1 #47 of 112
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 55.6 #16 of 170+1 versions & slices v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German MTEB 70.5 #23 of 165
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 64.2 #61 of 170
JMTEBv2 · Clustering · Japanese Embeddings group similar examples on jMTEB v2 · Clustering in Japanese MTEB 50.5 #31 of 157
MTEB Polishv1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 81.2 #43 of 153+1 versions & slices v1 · Classification · Polish Embeddings assign examples to categories on MTEB Polish v1 · Classification in Polish MTEB 61.9 #26 of 137
BRIGHTMean over tasks · English Embeddings rank relevant documents for queries on BRIGHT · mean over tasks in English; tasks receive equal weight MTEB 17.6 #9 of 28+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BRIGHT · mean over task types in English; task types receive equal weight MTEB 17.6 #9 of 28Retrieval · English Embeddings rank relevant documents for queries on BRIGHT · Retrieval in English MTEB 17.6 #9 of 28
No benchmark matches
CheaperQwen 3 Embedding 8BunstatedOpen+17%-92%$0.01
BetterEmbeddingGemma 300MunstatedOpen+6%-98%$0.002Max input: 16K tokens → 2K tokensaOpenGiga Embeddings Instruct 10B A1.8B 0826unstated+23%——Max input: 16K tokens → 8K tokens