Benchmark By Score Rank
Reranking 1
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 87.7 #57 of 200
Other 43
MTEB Englishv2 · Pair Classification · English Embeddings classify relationships between pairs in English MTEB 91.3 #4 of 238+5 versions & slices v2 · Reranking · English Embeddings reorder candidate documents by relevance in English MTEB 50.1 #14 of 223v2 · Classification · English Embeddings assign examples to categories in English MTEB 81.7 #60 of 222v2 · Summarization · English Embeddings match summaries to their source meaning in English MTEB 34.3 #33 of 209v2 · Clustering · English Embeddings group similar examples in English MTEB 50 #52 of 207v2 · STS · English Embeddings estimate semantic similarity between pairs in English MTEB 82.8 #55 of 200
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 39.3 #50 of 220+1 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 79.6 #47 of 202
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 34.2 #78 of 215
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 62.3 #113 of 206+5 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 43.3 #27 of 175v1 · Classification · multilingual (6 languages) Embeddings assign examples to categories on MTEB Scandinavian v1 · Classification in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish MTEB 61.7 #32 of 158v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish MTEB 69.2 #18 of 144v1 · Mean over tasks · multilingual (6 languages) Embeddings assign examples to categories, rank relevant documents for queries, group similar examples, find translated sentence pairs on MTEB Scandinavian v1 · mean over tasks in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; tasks receive equal weight MTEB 59.7 #25 of 135v1 · Mean over task types · multilingual (6 languages) Embeddings assign examples to categories, rank relevant documents for queries, group similar examples, find translated sentence pairs on MTEB Scandinavian v1 · mean over task types in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; task types receive equal weight MTEB 59.1 #28 of 135
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 56.4 #69 of 194+3 versions & slices v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 38.6 #36 of 162v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 57.6 #33 of 158v1.1 · Classification · Russian Embeddings assign examples to categories on MTEB Russian v1.1 · Classification in Russian MTEB 63.8 #33 of 146
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 17.2 #158 of 193
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 6.9 #113 of 192+4 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 12.4 #95 of 187v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 73.1 #86 of 183v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 59.4 #96 of 179v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 13.8 #64 of 162
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 27.3 #93 of 192+1 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 60.3 #95 of 182
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 64.3 #35 of 188
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 55.6 #18 of 175+1 versions & slices v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German MTEB 70.5 #26 of 168
MTEB Europev1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 78.2 #79 of 175+2 versions & slices v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 87 #51 of 154v1 · STS · multilingual (8 languages) Embeddings estimate semantic similarity between pairs on MTEB Europe v1 · STS in Dutch, English, Finnish, French, German, Italian, Polish, Spanish MTEB 74 #28 of 105
MTEB multilingualv2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 46.8 #81 of 173+2 versions & slices v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French MTEB 77.8 #53 of 166v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 70.1 #47 of 120
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 64.2 #61 of 171
JMTEBv2 · Clustering · Japanese Embeddings group similar examples on jMTEB v2 · Clustering in Japanese MTEB 50.5 #35 of 161
MTEB Polishv1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 81.2 #49 of 159+1 versions & slices v1 · Classification · Polish Embeddings assign examples to categories on MTEB Polish v1 · Classification in Polish MTEB 61.9 #31 of 144
BRIGHTMean over tasks · English Embeddings rank relevant documents for queries on BRIGHT · mean over tasks in English; tasks receive equal weight MTEB 17.6 #9 of 28+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on BRIGHT · mean over task types in English; task types receive equal weight MTEB 17.6 #9 of 28Retrieval · English Embeddings rank relevant documents for queries on BRIGHT · Retrieval in English MTEB 17.6 #9 of 28
No benchmark matches
CheaperJina Embeddings v5 Text SmallunstatedOpen+38%-58%$0.05iBetterE5 Base v2unstatedOpen+5%-96%$0.005Max input: 16K tokens → 1K tokens
CheaperQwen 3 Embedding 8BunstatedOpen+36%-92%$0.01
Bge M3unstatedOpen+11%-92%$0.01Max input: 16K tokens → 8K tokens
Harrier OSS v1 27BOpen+36%——OOcten Embedding 8BOpen+36%——