Benchmark By Score Rank
Reranking 25
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 88.8 #43 of 199+8 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 42.1 #22 of 133v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 30.9 #81 of 133v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 81 #14 of 133v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch MTEB 86.4 #4 of 133v1 · Classification · Dutch Embeddings assign examples to categories on MTEB Dutch v1 · Classification in Dutch MTEB 53.4 #68 of 131v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch MTEB 62.4 #19 of 131v1 · Mean over tasks · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over tasks in Dutch; tasks receive equal weight MTEB 56.1 #29 of 129v1 · Mean over task types · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over task types in Dutch; task types receive equal weight MTEB 63.6 #22 of 129
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB 0 #54 of 191+4 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 90.1 #14 of 174v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish MTEB 60 #29 of 174v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 30.8 #3 of 172v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 48 #21 of 166
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB 0 #54 of 191+10 versions & slices v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali MTEB 63.3 #27 of 174v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 67.7 #46 of 172v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 41.3 #3 of 172v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French MTEB 64.6 #20 of 172v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French MTEB 81.9 #15 of 165v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian MTEB 52.7 #23 of 159v2 · Classification · multilingual (119 languages) Embeddings assign examples to categories on MTEB Multilingual v2 · Classification in 119 languages including Achinese, Afrikaans, Albanian, Algerian Arabic, Amharic, Arabic, Armenian, Assamese MTEB 69.2 #13 of 153v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 78.2 #9 of 112v2 · Mean over tasks · multilingual (1037 languages) Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs, rank relevant documents for queries, find translated sentence pairs, rerank documents according to instructions, assign multiple labels to each example, reorder candidate documents by relevance on MTEB Multilingual v2 · mean over tasks in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; tasks receive equal weight MTEB 65.5 #15 of 83v2 · Mean over task types · multilingual (1037 languages) Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs, rank relevant documents for queries, find translated sentence pairs, rerank documents according to instructions, assign multiple labels to each example, reorder candidate documents by relevance on MTEB Multilingual v2 · mean over task types in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; task types receive equal weight MTEB 57.7 #14 of 83
Other 50
MTEB Englishv2 · Pair Classification · English MTEB English v2 · Pair Classification · English: embeddings classify relationships between pairs in English MTEB 84.7 #105 of 238+6 versions & slices v2 · Reranking · English MTEB English v2 · Reranking · English: embeddings reorder candidate documents by relevance in English MTEB 49.2 #34 of 223v2 · Classification · English MTEB English v2 · Classification · English: embeddings assign examples to categories in English MTEB 90.1 #21 of 222v2 · Summarization · English MTEB English v2 · Summarization · English: embeddings match summaries to their source meaning in English MTEB 31.9 #71 of 208v2 · Clustering · English MTEB English v2 · Clustering · English: embeddings group similar examples in English MTEB 53.5 #40 of 207v2 · STS · English MTEB English v2 · STS · English: embeddings estimate semantic similarity between pairs in English MTEB 88.3 #6 of 200v2 · Retrieval · English MTEB English v2 · Retrieval · English: embeddings rank relevant documents for queries in English MTEB 58.8 #32 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 41.4 #43 of 220
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 50.1 #37 of 212
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 57.8 #43 of 206
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 86 #2 of 205
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 53.7 #31 of 204
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 64.6 #18 of 193
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB 0 #54 of 191+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB 0 #54 of 191Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB 0 #54 of 191
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 41.4 #46 of 191+3 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 44.7 #28 of 186v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 86.4 #25 of 182v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 78.8 #21 of 178
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 20.7 #58 of 191
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 57 #18 of 191+6 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 78.8 #23 of 181v1 · Classification · Thai Embeddings assign examples to categories on MTEB Thai v1 · Classification in Thai MTEB 64.2 #17 of 32v1 · Reranking · Thai Embeddings reorder candidate documents by relevance on MTEB Thai v1 · Reranking in Thai MTEB 54.4 #16 of 29v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Thai v1 · Retrieval in English, Thai MTEB 64.4 #7 of 27v1 · Mean over tasks · multilingual (2 languages) Embeddings group similar examples, assign examples to categories, classify relationships between pairs, rank relevant documents for queries, reorder candidate documents by relevance on MTEB Thai v1 · mean over tasks in English, Thai; tasks receive equal weight MTEB 63.5 #11 of 26v1 · Mean over task types · multilingual (2 languages) Embeddings group similar examples, assign examples to categories, classify relationships between pairs, rank relevant documents for queries, reorder candidate documents by relevance on MTEB Thai v1 · mean over task types in English, Thai; task types receive equal weight MTEB 63.8 #10 of 26
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 66.7 #18 of 187
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 56.2 #14 of 170+7 versions & slices v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German MTEB 85.4 #8 of 165v1 · Clustering · German Embeddings group similar examples on MTEB German v1 · Clustering in German MTEB 41 #7 of 164v1 · Reranking · German Embeddings reorder candidate documents by relevance on MTEB German v1 · Reranking in German MTEB 55.1 #3 of 148v1 · STS · German Embeddings estimate semantic similarity between pairs on MTEB German v1 · STS in German MTEB 78.1 #1 of 128v1 · Retrieval · German Embeddings rank relevant documents for queries on MTEB German v1 · Retrieval in German MTEB 57.6 #7 of 110v1 · Mean over tasks · German Embeddings group similar examples, rank relevant documents for queries, assign examples to categories, estimate semantic similarity between pairs, classify relationships between pairs, reorder candidate documents by relevance on MTEB German v1 · mean over tasks in German; tasks receive equal weight MTEB 64.8 #5 of 101v1 · Mean over task types · German Embeddings group similar examples, rank relevant documents for queries, assign examples to categories, estimate semantic similarity between pairs, classify relationships between pairs, reorder candidate documents by relevance on MTEB German v1 · mean over task types in German; task types receive equal weight MTEB 62.2 #4 of 101
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 74.5 #15 of 170+7 versions & slices v1 · Reranking · Spanish Embeddings reorder candidate documents by relevance on MTEB Spanish v1 · Reranking in Spanish MTEB 63.7 #6 of 148v1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 49.1 #14 of 127v1 · STS · multilingual (2 languages) Embeddings estimate semantic similarity between pairs on MTEB Spanish v1 · STS in English, Spanish MTEB 81.7 #3 of 76v1 · Classification · Spanish Embeddings assign examples to categories on MTEB Spanish v1 · Classification in Spanish MTEB 74.7 #23 of 27v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Spanish v1 · Retrieval in English, Spanish MTEB 56.3 #7 of 27v1 · Mean over tasks · multilingual (2 languages) Embeddings classify relationships between pairs, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over tasks in English, Spanish; tasks receive equal weight MTEB 66.8 #9 of 26v1 · Mean over task types · multilingual (2 languages) Embeddings classify relationships between pairs, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over task types in English, Spanish; task types receive equal weight MTEB 66.7 #9 of 26
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 63.7 #30 of 168+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 63.7 #30 of 168Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 63.7 #30 of 168
RTEB Finnish betaMean over tasks · English Embeddings rank relevant documents for queries on RTEB Finnish Beta · mean over tasks in English; tasks receive equal weight MTEB 64.8 #30 of 90
RTEB Health betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 61.1 #26 of 90
No benchmark matches
CheaperQwen 3 Embedding 0.6BunstatedOpensame-50%$0.01Memory (4-bit): 0.1 GB → 0.4 GBcBetterF2LLM v2 14BunstatedOpen+28%——Memory (4-bit): 0.1 GB → 8.4 GBcOpenF2LLM v2 8Bunstated+27%——Memory (4-bit): 0.1 GB → 4.5 GBiCheaperMultilingual E5 Large InstructunstatedOpen-2%-50%$0.01Max input: 8K tokens → 1K tokens+1
CheaperBge M3unstatedOpen-3%-50%$0.01Memory (4-bit): 0.1 GB → 0.3 GB