Benchmark By Score Rank
Reranking 15
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 73 #161 of 200+8 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 17 #109 of 133v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 27.4 #104 of 133v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 61.6 #91 of 133v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch MTEB 57.2 #100 of 133v1 · Classification · Dutch Embeddings assign examples to categories on MTEB Dutch v1 · Classification in Dutch MTEB 44.8 #103 of 131v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch MTEB 32 #94 of 131v1 · Mean over tasks · Dutch Embeddings rank relevant documents for queries, assign examples to categories, assign multiple labels to each example, estimate semantic similarity between pairs, group similar examples, reorder candidate documents by relevance, classify relationships between pairs on MTEB Dutch v1 · mean over tasks in Dutch; tasks receive equal weight MTEB 36.3 #101 of 129v1 · Mean over task types · Dutch Embeddings rank relevant documents for queries, assign examples to categories, assign multiple labels to each example, estimate semantic similarity between pairs, group similar examples, reorder candidate documents by relevance, classify relationships between pairs on MTEB Dutch v1 · mean over task types in Dutch; task types receive equal weight MTEB 44.7 #100 of 129
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB -4.3 #190 of 192+2 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 46.8 #97 of 175v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 80.5 #121 of 154
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB -4.3 #190 of 192+2 versions & slices v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 26.3 #110 of 173v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French MTEB 71.6 #128 of 166
Other 60
MTEB Englishv2 · Pair Classification · English Embeddings classify relationships between pairs in English MTEB 83 #145 of 238+5 versions & slices v2 · Reranking · English Embeddings reorder candidate documents by relevance in English MTEB 47 #99 of 223v2 · Summarization · English Embeddings match summaries to their source meaning in English MTEB 27.2 #161 of 209v2 · Clustering · English Embeddings group similar examples in English MTEB 39.9 #163 of 207v2 · STS · English Embeddings estimate semantic similarity between pairs in English MTEB 80 #115 of 200v2 · Retrieval · English Embeddings rank relevant documents for queries in English MTEB 46.4 #125 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 31.2 #175 of 220+4 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 10.4 #177 of 202v1 · Retrieval · multilingual (10 languages) Embeddings rank relevant documents for queries on MTEB Medical v1 · Retrieval in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese MTEB 36 #94 of 140v1 · Mean over tasks · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over tasks in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; tasks receive equal weight MTEB 33.1 #95 of 138v1 · Mean over task types · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over task types in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; task types receive equal weight MTEB 25.9 #106 of 138
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 26.9 #103 of 215
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 29.9 #101 of 212
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 34.4 #103 of 209
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 57.2 #151 of 206+2 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 27.8 #133 of 175v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish MTEB 29.6 #105 of 144
BEIRMean over tasks · English Embeddings rank relevant documents for queries on BEIR · mean over tasks in English; tasks receive equal weight MTEB 44 #134 of 196+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BEIR · mean over task types in English; task types receive equal weight MTEB 44 #134 of 196Retrieval · English Embeddings rank relevant documents for queries on BEIR · Retrieval in English MTEB 44 #134 of 196
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 48.8 #138 of 194+5 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 26.5 #109 of 162v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 15.6 #126 of 158v1.1 · Reranking · Russian Embeddings reorder candidate documents by relevance on MTEB Russian v1.1 · Reranking in Russian MTEB 19.8 #120 of 153v1.1 · STS · Russian Embeddings estimate semantic similarity between pairs on MTEB Russian v1.1 · STS in Russian MTEB 36.3 #117 of 139v1.1 · Retrieval · Russian Embeddings rank relevant documents for queries on MTEB Russian v1.1 · Retrieval in Russian MTEB 4.7 #78 of 109
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 15.5 #179 of 193
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB -4.3 #190 of 192+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB -4.3 #190 of 192Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB -4.3 #190 of 192
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 3 #140 of 192+2 versions & slices v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 52.6 #147 of 179v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 6.8 #78 of 162
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 58.5 #83 of 188+4 versions & slices v1 · Summarization · French Embeddings match summaries to their source meaning on MTEB French v1 · Summarization in French MTEB 30.2 #72 of 158v1 · Reranking · French Embeddings reorder candidate documents by relevance on MTEB French v1 · Reranking in French MTEB 73.4 #53 of 144v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB French v1 · Retrieval in English, French MTEB 44.9 #47 of 138v1 · Clustering · French Embeddings group similar examples on MTEB French v1 · Clustering in French MTEB 39.4 #68 of 120
MTEB Thaiv1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 51.6 #137 of 182
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 50.1 #85 of 175+4 versions & slices v1 · Clustering · German Embeddings group similar examples on MTEB German v1 · Clustering in German MTEB 25.3 #81 of 167v1 · Reranking · German Embeddings reorder candidate documents by relevance on MTEB German v1 · Reranking in German MTEB 36.5 #57 of 148v1 · STS · German Embeddings estimate semantic similarity between pairs on MTEB German v1 · STS in German MTEB 59.3 #56 of 137v1 · Retrieval · German Embeddings rank relevant documents for queries on MTEB German v1 · Retrieval in German MTEB 42.6 #44 of 127
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 57.3 #130 of 171+3 versions & slices v1 · Reranking · Spanish Embeddings reorder candidate documents by relevance on MTEB Spanish v1 · Reranking in Spanish MTEB 35.5 #85 of 148v1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 39.1 #89 of 127v1 · Classification · Spanish Embeddings assign examples to categories on MTEB Spanish v1 · Classification in Spanish MTEB 70.1 #71 of 101
JMTEBv2 · STS · Japanese Embeddings estimate semantic similarity between pairs on jMTEB v2 · STS in Japanese MTEB 4 #167 of 168
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 37.2 #88 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 37.2 #88 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 37.2 #88 of 168
MTEB Lawv1 · Mean over tasks · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over tasks in Chinese, English, German; tasks receive equal weight MTEB 40.8 #82 of 167+2 versions & slices v1 · Mean over task types · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over task types in Chinese, English, German; task types receive equal weight MTEB 40.8 #82 of 167v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · Retrieval in Chinese, English, German MTEB 40.8 #82 of 167
MTEB Polishv1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 60.8 #134 of 159+2 versions & slices v1 · STS · Polish Embeddings estimate semantic similarity between pairs on MTEB Polish v1 · STS in Polish MTEB 49.8 #111 of 132v1 · Clustering · Polish Embeddings group similar examples on MTEB Polish v1 · Clustering in Polish MTEB 22.2 #89 of 121
MTEB Koreanv2 · Classification · Korean Embeddings assign examples to categories on MTEB Korean v2 · Classification in Korean MTEB 20.8 #128 of 156+1 versions & slices v2 · Reranking · Korean Embeddings reorder candidate documents by relevance on MTEB Korean v2 · Reranking in Korean MTEB 5.8 #135 of 155
No benchmark matches
CheaperQwen 3 Embedding 8BunstatedOpen+16%-80%$0.01Languages: not verified+1
BetterEmbeddingGemma 300MunstatedOpen+13%-96%$0.002Languages: not verified+1
CheaperBge M3unstatedOpen+12%-80%$0.01Languages: not verified+1
Harrier OSS v1 0.6BunstatedOpen+14%——Memory (4-bit): 0.1 GB → 0.4 GB