Benchmark By Score Rank
Reranking 19
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 90.2 #29 of 199+5 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 42.7 #21 of 133v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 30.9 #79 of 133v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 81.2 #13 of 133v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch MTEB 86.1 #7 of 133v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch MTEB 63.1 #17 of 131
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB 1.3 #27 of 191+4 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 90.9 #10 of 174v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish MTEB 60.9 #18 of 174v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 31.8 #2 of 172v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 48.2 #20 of 166
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB 1.3 #27 of 191+6 versions & slices v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali MTEB 64.9 #20 of 174v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 69.7 #36 of 172v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 42 #2 of 172v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French MTEB 65.7 #13 of 172v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian MTEB 53.4 #19 of 159v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 78.8 #8 of 112
MTEB Mandarin Chinesev1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Chinese v1 · Reranking in Mandarin Chinese MTEB 66.4 #32 of 71
Other 36 Leads on 1
MTEB Englishv2 · Pair Classification · English MTEB English v2 · Pair Classification · English: embeddings classify relationships between pairs in English MTEB 85 #94 of 238+5 versions & slices v2 · Reranking · English MTEB English v2 · Reranking · English: embeddings reorder candidate documents by relevance in English MTEB 49.4 #28 of 223v2 · Summarization · English MTEB English v2 · Summarization · English: embeddings match summaries to their source meaning in English MTEB 31.8 #77 of 208v2 · Clustering · English MTEB English v2 · Clustering · English: embeddings group similar examples in English MTEB 54.7 #36 of 207v2 · STS · English MTEB English v2 · STS · English: embeddings estimate semantic similarity between pairs in English MTEB 88.1 #7 of 200v2 · Retrieval · English MTEB English v2 · Retrieval · English: embeddings rank relevant documents for queries in English MTEB 60.1 #21 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 42.5 #35 of 220
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 51.3 #32 of 212
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 63.6 #30 of 206
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 86 #1 of 205
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 56.4 #27 of 204
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 67.3 #8 of 193
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB 1.3 #27 of 191+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB 1.3 #27 of 191Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB 1.3 #27 of 191
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 47.8 #32 of 191+3 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 48.1 #22 of 186v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 87 #18 of 182v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 79.8 #17 of 178
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 21.3 #49 of 191
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 55.2 #25 of 191+2 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 79.2 #21 of 181v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Thai v1 · Retrieval in English, Thai MTEB 64.6 #6 of 27
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 58.6 #7 of 170+3 versions & slices v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German MTEB 86.4 #6 of 165v1 · Clustering · German Embeddings group similar examples on MTEB German v1 · Clustering in German MTEB 41.3 #5 of 164v1 · Reranking · German Embeddings reorder candidate documents by relevance on MTEB German v1 · Reranking in German MTEB 54.9 #4 of 148
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 66.4 #23 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 66.4 #23 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 66.4 #23 of 168
MTEB Spanishv1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 48.8 #18 of 127+3 versions & slices v1 · STS · multilingual (2 languages) Embeddings estimate semantic similarity between pairs on MTEB Spanish v1 · STS in English, Spanish MTEB 82.5 #2 of 76v1 · Classification · Spanish Embeddings assign examples to categories on MTEB Spanish v1 · Classification in Spanish MTEB 80.3 #21 of 27v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Spanish v1 · Retrieval in English, Spanish MTEB 56.7 #6 of 27
RTEB Finnish betaMean over tasks · English Embeddings rank relevant documents for queries on RTEB Finnish Beta · mean over tasks in English; tasks receive equal weight MTEB 66.1 #29 of 90
RTEB Health betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 62.3 #22 of 90
No benchmark matches
CheaperQwen 3 Embedding 8BunstatedOpen+16%-80%$0.01Memory (4-bit): 0.4 GB → 4.5 GB
OpenKaLM Embedding Gemma3 12B 2511+20%——Memory (4-bit): 0.4 GB → 7.1 GBiCheaperMultilingual E5 Large InstructunstatedOpen+15%-80%$0.01Max input: 33K tokens → 1K tokens
Gemini Embedding 001unstated+14%+200%$0.15Max input: 33K tokens → 2K tokens
Harrier OSS v1 0.6BunstatedOpen+19%——
Llama Embed Nemotron 8BOpen+17%——Memory (4-bit): 0.4 GB → 4.5 GB