Benchmark By Score Rank
Retrieval 8
MTEB Mandarin Chinesev1 · Retrieval · Mandarin Chinese Embeddings rank relevant documents for queries on MTEB Chinese v1 · Retrieval in Mandarin Chinese MTEB 71 #39 of 83+7 versions & slices v1 · Pair Classification · Mandarin Chinese Embeddings classify relationships between pairs on MTEB Chinese v1 · Pair Classification in Mandarin Chinese MTEB 76.4 #29 of 81v1 · STS · Mandarin Chinese Embeddings estimate semantic similarity between pairs on MTEB Chinese v1 · STS in Mandarin Chinese MTEB 54.5 #30 of 81v1 · Clustering · Mandarin Chinese Embeddings group similar examples on MTEB Chinese v1 · Clustering in Mandarin Chinese MTEB 68.7 #15 of 80v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Chinese v1 · Reranking in Mandarin Chinese MTEB 62.6 #43 of 71v1 · Classification · Mandarin Chinese Embeddings assign examples to categories on MTEB Chinese v1 · Classification in Mandarin Chinese MTEB 71.5 #23 of 52v1 · Mean over tasks · Mandarin Chinese Embeddings rank relevant documents for queries, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, assign examples to categories on MTEB Chinese v1 · mean over tasks in Mandarin Chinese; tasks receive equal weight MTEB 66.4 #19 of 31v1 · Mean over task types · Mandarin Chinese Embeddings rank relevant documents for queries, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, assign examples to categories on MTEB Chinese v1 · mean over task types in Mandarin Chinese; task types receive equal weight MTEB 67.5 #17 of 31
Reranking 25
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 86.5 #70 of 199+8 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 38.9 #28 of 133v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 36 #35 of 133v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 75.2 #49 of 133v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch MTEB 58.9 #92 of 133v1 · Classification · Dutch Embeddings assign examples to categories on MTEB Dutch v1 · Classification in Dutch MTEB 61.5 #32 of 131v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch MTEB 55 #47 of 131v1 · Mean over tasks · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over tasks in Dutch; tasks receive equal weight MTEB 54.3 #37 of 129v1 · Mean over task types · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over task types in Dutch; task types receive equal weight MTEB 58.8 #45 of 129
MTEB Europev1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB 5.1 #12 of 191+4 versions & slices v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 86.8 #42 of 174v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish MTEB 59.6 #33 of 174v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 20.4 #20 of 172v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 45.3 #37 of 166
MTEB multilingualv2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB 5.1 #12 of 191+10 versions & slices v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali MTEB 64.6 #22 of 174v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 72.2 #24 of 172v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 24.6 #27 of 172v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French MTEB 61.4 #51 of 172v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French MTEB 80.8 #27 of 165v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian MTEB 52.3 #25 of 159v2 · Classification · multilingual (119 languages) Embeddings assign examples to categories on MTEB Multilingual v2 · Classification in 119 languages including Achinese, Afrikaans, Albanian, Algerian Arabic, Amharic, Arabic, Armenian, Assamese MTEB 66.8 #18 of 153v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 76.2 #15 of 112v2 · Mean over tasks · multilingual (1037 languages) Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs, rank relevant documents for queries, find translated sentence pairs, rerank documents according to instructions, assign multiple labels to each example, reorder candidate documents by relevance on MTEB Multilingual v2 · mean over tasks in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; tasks receive equal weight MTEB 64.3 #17 of 83v2 · Mean over task types · multilingual (1037 languages) Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs, rank relevant documents for queries, find translated sentence pairs, rerank documents according to instructions, assign multiple labels to each example, reorder candidate documents by relevance on MTEB Multilingual v2 · mean over task types in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; task types receive equal weight MTEB 56 #18 of 83
Other 60
MTEB Englishv2 · Pair Classification · English MTEB English v2 · Pair Classification · English: embeddings classify relationships between pairs in English MTEB 84.4 #115 of 238+6 versions & slices v2 · Reranking · English MTEB English v2 · Reranking · English: embeddings reorder candidate documents by relevance in English MTEB 48.2 #58 of 223v2 · Classification · English MTEB English v2 · Classification · English: embeddings assign examples to categories in English MTEB 84.6 #51 of 222v2 · Summarization · English MTEB English v2 · Summarization · English: embeddings match summaries to their source meaning in English MTEB 33.4 #44 of 208v2 · Clustering · English MTEB English v2 · Clustering · English: embeddings group similar examples in English MTEB 54.1 #38 of 207v2 · STS · English MTEB English v2 · STS · English: embeddings estimate semantic similarity between pairs in English MTEB 86.6 #10 of 200v2 · Retrieval · English MTEB English v2 · Retrieval · English: embeddings rank relevant documents for queries in English MTEB 61.8 #15 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 41.3 #45 of 220+1 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 81.4 #40 of 199
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 73.5 #22 of 205+5 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 48.1 #13 of 170v1 · Classification · multilingual (6 languages) Embeddings assign examples to categories on MTEB Scandinavian v1 · Classification in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish MTEB 64.6 #20 of 151v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish MTEB 61.8 #34 of 56v1 · Mean over tasks · multilingual (6 languages) Embeddings group similar examples, assign examples to categories, rank relevant documents for queries, find translated sentence pairs on MTEB Scandinavian v1 · mean over tasks in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; tasks receive equal weight MTEB 61 #16 of 47v1 · Mean over task types · multilingual (6 languages) Embeddings group similar examples, assign examples to categories, rank relevant documents for queries, find translated sentence pairs on MTEB Scandinavian v1 · mean over task types in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; task types receive equal weight MTEB 62 #12 of 47
BEIRMean over tasks · English Embeddings rank relevant documents for queries on BEIR · mean over tasks in English; tasks receive equal weight MTEB 55.5 #36 of 194+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BEIR · mean over task types in English; task types receive equal weight MTEB 55.5 #36 of 194Retrieval · English Embeddings rank relevant documents for queries on BEIR · Retrieval in English MTEB 55.5 #36 of 194
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 60.7 #32 of 193+8 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 40.1 #26 of 159v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 60.5 #23 of 155v1.1 · Reranking · Russian Embeddings reorder candidate documents by relevance on MTEB Russian v1.1 · Reranking in Russian MTEB 63 #42 of 153v1.1 · Classification · Russian Embeddings assign examples to categories on MTEB Russian v1.1 · Classification in Russian MTEB 67.2 #24 of 144v1.1 · STS · Russian Embeddings estimate semantic similarity between pairs on MTEB Russian v1.1 · STS in Russian MTEB 74.2 #17 of 137v1.1 · Retrieval · Russian Embeddings rank relevant documents for queries on MTEB Russian v1.1 · Retrieval in Russian MTEB 67.6 #21 of 109v1.1 · Mean over tasks · Russian Embeddings assign examples to categories, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, rank relevant documents for queries, assign multiple labels to each example on MTEB Russian v1.1 · mean over tasks in Russian; tasks receive equal weight MTEB 64.3 #17 of 106v1.1 · Mean over task types · Russian Embeddings assign examples to categories, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, rank relevant documents for queries, assign multiple labels to each example on MTEB Russian v1.1 · mean over task types in Russian; task types receive equal weight MTEB 61.9 #18 of 106
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB 5.1 #12 of 191+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB 5.1 #12 of 191Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB 5.1 #12 of 191
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 39 #50 of 191+3 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 39.4 #34 of 186v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 82.5 #58 of 182v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 77.2 #28 of 178
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 22.6 #25 of 191+6 versions & slices v1 · Classification · Portuguese Embeddings assign examples to categories on MTEB Portuguese v1 · Classification in Portuguese MTEB 61.1 #6 of 27v1 · Retrieval · Portuguese Embeddings rank relevant documents for queries on MTEB Portuguese v1 · Retrieval in Portuguese MTEB 78.8 #1 of 22v1 · Mean over tasks · Portuguese Embeddings assign examples to categories, rank relevant documents for queries, assign multiple labels to each example, estimate semantic similarity between pairs, reorder candidate documents by relevance on MTEB Portuguese v1 · mean over tasks in Portuguese; tasks receive equal weight MTEB 71.6 #3 of 20v1 · Mean over task types · Portuguese Embeddings assign examples to categories, rank relevant documents for queries, assign multiple labels to each example, estimate semantic similarity between pairs, reorder candidate documents by relevance on MTEB Portuguese v1 · mean over task types in Portuguese; task types receive equal weight MTEB 65.8 #2 of 20v1 · Reranking · Portuguese Embeddings reorder candidate documents by relevance on MTEB Portuguese v1 · Reranking in Portuguese MTEB 85.7 #2 of 20v1 · STS · Portuguese Embeddings estimate semantic similarity between pairs on MTEB Portuguese v1 · STS in Portuguese MTEB 80.7 #8 of 20
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 52.4 #36 of 191+6 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 81.1 #16 of 181v1 · Classification · Thai Embeddings assign examples to categories on MTEB Thai v1 · Classification in Thai MTEB 67.9 #11 of 32v1 · Reranking · Thai Embeddings reorder candidate documents by relevance on MTEB Thai v1 · Reranking in Thai MTEB 57.8 #13 of 29v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Thai v1 · Retrieval in English, Thai MTEB 61.8 #13 of 27v1 · Mean over tasks · multilingual (2 languages) Embeddings group similar examples, assign examples to categories, classify relationships between pairs, rank relevant documents for queries, reorder candidate documents by relevance on MTEB Thai v1 · mean over tasks in English, Thai; tasks receive equal weight MTEB 63.5 #10 of 26v1 · Mean over task types · multilingual (2 languages) Embeddings group similar examples, assign examples to categories, classify relationships between pairs, rank relevant documents for queries, reorder candidate documents by relevance on MTEB Thai v1 · mean over task types in English, Thai; task types receive equal weight MTEB 64.2 #9 of 26
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 67.5 #13 of 187
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 75.3 #11 of 170
CoIRMean over tasks · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · mean over tasks in English, c++, go, java, javascript, php, python, ruby, sql; tasks receive equal weight MTEB 75 #17 of 58+2 versions & slices Mean over task types · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · mean over task types in English, c++, go, java, javascript, php, python, ruby, sql; task types receive equal weight MTEB 75 #17 of 58Retrieval · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · Retrieval in English, c++, go, java, javascript, php, python, ruby, sql MTEB 75 #17 of 58
MTEB Codev1 · Mean over tasks · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · mean over tasks in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript; tasks receive equal weight MTEB 75.4 #20 of 51+2 versions & slices v1 · Mean over task types · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · mean over task types in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript; task types receive equal weight MTEB 75.4 #20 of 51v1 · Retrieval · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · Retrieval in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript MTEB 75.4 #20 of 51
CoREBv1 · Mean over tasks · multilingual (6 languages) Embeddings reorder candidate documents by relevance, rank relevant documents for queries on CoReB v1 · mean over tasks in English, c++, go, java, python, ruby; tasks receive equal weight MTEB 54.1 #17 of 23+3 versions & slices v1 · Mean over task types · multilingual (6 languages) Embeddings reorder candidate documents by relevance, rank relevant documents for queries on CoReB v1 · mean over task types in English, c++, go, java, python, ruby; task types receive equal weight MTEB 54.1 #17 of 23v1 · Reranking · multilingual (6 languages) Embeddings reorder candidate documents by relevance on CoReB v1 · Reranking in English, c++, go, java, python, ruby MTEB 52 #17 of 23v1 · Retrieval · multilingual (6 languages) Embeddings rank relevant documents for queries on CoReB v1 · Retrieval in English, c++, go, java, python, ruby MTEB 56.2 #17 of 23
No benchmark matches
CheaperEmbeddingGemma 300MunstatedOpensame-80%$0.002Max input: 33K tokens → 2K tokens
OpenJina Embeddings v5 Text Smallunstated+71%+400%$0.05
CheaperBge Base En v1.5unstatedOpen-33%-50%$0.005Max input: 33K tokens → 1K tokenssCheaperAll Mpnet Base v2unstatedOpen-34%-50%$0.005Max input: 33K tokens → 0K tokens
KaLM Embedding Gemma3 12B 2511Open+34%——Memory (4-bit): 0.4 GB → 7.1 GBaGiga Embeddings Instruct 3B 0826unstatedOpen+33%——Max input: 33K tokens → 8K tokens+1