Benchmark By Score Rank
Reranking 20 Leads on 1
MAEB v1 audio-onlyAudio Reranking · No linguistic content Embeddings reorder candidate audio clips by relevance on Maeb v1 Audio Only · Audio Reranking in No linguistic content MTEB 84.4 #4 of 27+6 versions & slices Audio Clustering · multilingual (6 languages) Embeddings group similar audio clips on Maeb v1 Audio Only · Audio Clustering in English, French, German, No linguistic content, Polish, Spanish MTEB 6.1 #10 of 26Audio Pair Classification · English Embeddings classify relationships between audio clips on Maeb v1 Audio Only · Audio Pair Classification in English MTEB 65.4 #7 of 26Any-to-any Retrieval · multilingual (4 languages) Embeddings retrieve matching examples across modalities on Maeb v1 Audio Only · Any-to-any Retrieval in English, French, German, Spanish MTEB 83.9 #12 of 25Mean over tasks · multilingual (102 languages) Embeddings classify relationships between audio clips, reorder candidate audio clips by relevance, group similar audio clips, classify audio clips, retrieve matching examples across modalities on Maeb v1 Audio Only · mean over tasks in 102 languages including Afrikaans, Amharic, Armenian, Assamese, Asturian, Belarusian, Bengali, Bosnian; tasks receive equal weight MTEB 50.2 #4 of 23Mean over task types · multilingual (102 languages) Embeddings classify relationships between audio clips, reorder candidate audio clips by relevance, group similar audio clips, classify audio clips, retrieve matching examples across modalities on Maeb v1 Audio Only · mean over task types in 102 languages including Afrikaans, Amharic, Armenian, Assamese, Asturian, Belarusian, Bengali, Bosnian; task types receive equal weight MTEB 58.4 #3 of 23Audio Classification · multilingual (102 languages) Embeddings classify audio clips on Maeb v1 Audio Only · Audio Classification in 102 languages including Afrikaans, Amharic, Armenian, Assamese, Asturian, Belarusian, Bengali, Bosnian MTEB 52 #7 of 23
MAEBv1 · Audio Reranking · No linguistic content Embeddings reorder candidate audio clips by relevance on Maeb v1 · Audio Reranking in No linguistic content MTEB 84.4 #4 of 27+8 versions & slices v1 · Audio Zero-shot Classification · English Embeddings classify audio using unseen labels on Maeb v1 · Audio Zero-shot Classification in English MTEB 62.2 #6 of 27v1 · Audio Clustering · multilingual (6 languages) Embeddings group similar audio clips on Maeb v1 · Audio Clustering in English, French, German, No linguistic content, Polish, Spanish MTEB 6.1 #10 of 26v1 · Audio Multilabel Classification · English Embeddings assign multiple labels to audio clips on Maeb v1 · Audio Multilabel Classification in English MTEB 69.3 #12 of 26v1 · Audio Pair Classification · English Embeddings classify relationships between audio clips on Maeb v1 · Audio Pair Classification in English MTEB 65.4 #7 of 26v1 · Any-to-any Retrieval · multilingual (150 languages) Embeddings retrieve matching examples across modalities on Maeb v1 · Any-to-any Retrieval in 150 languages including Abkhazian, Afrikaans, Albanian, Amharic, Arabic, Armenian, Assamese, Asturian MTEB 49.8 #7 of 24v1 · Mean over tasks · multilingual (159 languages) Embeddings classify relationships between audio clips, group similar audio clips, retrieve matching examples across modalities, classify audio using unseen labels, classify audio clips, assign multiple labels to audio clips, reorder candidate audio clips by relevance on Maeb v1 · mean over tasks in 159 languages including Abkhazian, Afrikaans, Albanian, Amharic, Arabic, Armenian, Assamese, Asturian; tasks receive equal weight MTEB 50.4 #5 of 23v1 · Mean over task types · multilingual (159 languages) Embeddings classify relationships between audio clips, group similar audio clips, retrieve matching examples across modalities, classify audio using unseen labels, classify audio clips, assign multiple labels to audio clips, reorder candidate audio clips by relevance on Maeb v1 · mean over task types in 159 languages including Abkhazian, Afrikaans, Albanian, Amharic, Arabic, Armenian, Assamese, Asturian; task types receive equal weight MTEB 55.6 #3 of 23v1 · Audio Classification · multilingual (102 languages) Embeddings classify audio clips on Maeb v1 · Audio Classification in 102 languages including Afrikaans, Amharic, Armenian, Assamese, Asturian, Belarusian, Bengali, Bosnian MTEB 52 #7 of 23
MTEB Dutchv1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch MTEB 90.2 #1 of 4+3 versions & slices v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch MTEB 42.4 #1 of 1v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch MTEB 31 #1 of 1v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch MTEB 81.2 #1 of 1
Other 146 Leads on 8
MIEB liteDocument Understanding · English Embeddings match queries to document content on MIEB Lite · Document Understanding in English MTEB 74.2 #47 of 89+11 versions & slices Visual semantic similarity (multilingual) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Lite · Visual STS (multilingual) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 65.1 #9 of 56Visual semantic similarity (English) · English Embeddings estimate visual semantic similarity on MIEB Lite · Visual STS (English) in English MTEB 83.4 #4 of 54Image Classification · English Embeddings classify images on MIEB Lite · Image Classification in English MTEB 74.1 #14 of 53Image Clustering · English Embeddings group similar images on MIEB Lite · Image Clustering in English MTEB 83.2 #2 of 53Any-to-any Multilingual Retrieval · multilingual (40 languages) Embeddings retrieve matching examples across languages and modalities on MIEB Lite · Any-to-any Multilingual Retrieval in 40 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish MTEB 53.7 #9 of 48Vision Centric QA · English Embeddings match visual content to questions on MIEB Lite · Vision Centric QA in English MTEB 56.2 #9 of 48Mean over tasks · multilingual (41 languages) Embeddings retrieve matching examples across modalities, retrieve matching examples across languages and modalities, match queries to document content, assign unseen category labels to examples, estimate visual semantic similarity, match visual content to questions, estimate visual semantic similarity, classify images, distinguish changes in how objects and attributes are combined, group similar images on MIEB Lite · mean over tasks in 41 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish; tasks receive equal weight MTEB 61.1 #6 of 47Mean over task types · multilingual (41 languages) Embeddings retrieve matching examples across modalities, retrieve matching examples across languages and modalities, match queries to document content, assign unseen category labels to examples, estimate visual semantic similarity, match visual content to questions, estimate visual semantic similarity, classify images, distinguish changes in how objects and attributes are combined, group similar images on MIEB Lite · mean over task types in 41 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish; task types receive equal weight MTEB 61.1 #6 of 47Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MIEB Lite · Any-to-any Retrieval in English MTEB 27.6 #26 of 47Compositionality · English Embeddings distinguish changes in how objects and attributes are combined on MIEB Lite · Compositionality in English MTEB 40.5 #5 of 47Zero-shot Classification · English Embeddings assign unseen category labels to examples on MIEB Lite · Zero-shot Classification in English MTEB 52.8 #26 of 47
MIEB EnglishDocument Understanding · English Embeddings match queries to document content on MIEB English · Document Understanding in English MTEB 79.3 #44 of 81+9 versions & slices Visual semantic similarity (English) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB English · Visual STS (English) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 81.7 #2 of 46Image Classification · English Embeddings classify images on MIEB English · Image Classification in English MTEB 75.3 #22 of 45Image Clustering · English Embeddings group similar images on MIEB English · Image Clustering in English MTEB 86 #3 of 45Vision Centric QA · English Embeddings match visual content to questions on MIEB English · Vision Centric QA in English MTEB 53.4 #5 of 40Compositionality · English Embeddings distinguish changes in how objects and attributes are combined on MIEB English · Compositionality in English MTEB 46.1 #2 of 39Zero-shot Classification · English Embeddings assign unseen category labels to examples on MIEB English · Zero-shot Classification in English MTEB 63 #13 of 39Mean over tasks · multilingual (13 languages) Embeddings match queries to document content, retrieve matching examples across modalities, match visual content to questions, assign unseen category labels to examples, classify images, group similar images, estimate visual semantic similarity, distinguish changes in how objects and attributes are combined on MIEB English · mean over tasks in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish; tasks receive equal weight MTEB 65.3 #2 of 37Mean over task types · multilingual (13 languages) Embeddings match queries to document content, retrieve matching examples across modalities, match visual content to questions, assign unseen category labels to examples, classify images, group similar images, estimate visual semantic similarity, distinguish changes in how objects and attributes are combined on MIEB English · mean over task types in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish; task types receive equal weight MTEB 65.3 #2 of 37Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MIEB English · Any-to-any Retrieval in English MTEB 37.9 #13 of 37
MIEB multilingualDocument Understanding · English Embeddings match queries to document content on MIEB Multilingual · Document Understanding in English MTEB 79.3 #44 of 81+11 versions & slices Visual semantic similarity (multilingual) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Multilingual · Visual STS (multilingual) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 65.1 #9 of 56Visual semantic similarity (English) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Multilingual · Visual STS (English) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 81.7 #2 of 46Image Classification · English Embeddings classify images on MIEB Multilingual · Image Classification in English MTEB 75.3 #22 of 45Image Clustering · English Embeddings group similar images on MIEB Multilingual · Image Clustering in English MTEB 86 #3 of 45Vision Centric QA · English Embeddings match visual content to questions on MIEB Multilingual · Vision Centric QA in English MTEB 53.4 #5 of 40Any-to-any Multilingual Retrieval · multilingual (40 languages) Embeddings retrieve matching examples across languages and modalities on MIEB Multilingual · Any-to-any Multilingual Retrieval in 40 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish MTEB 62.8 #3 of 39Compositionality · English Embeddings distinguish changes in how objects and attributes are combined on MIEB Multilingual · Compositionality in English MTEB 46.1 #2 of 39Zero-shot Classification · English Embeddings assign unseen category labels to examples on MIEB Multilingual · Zero-shot Classification in English MTEB 63 #13 of 39Mean over tasks · multilingual (41 languages) Embeddings retrieve matching examples across modalities, classify images, match queries to document content, distinguish changes in how objects and attributes are combined, assign unseen category labels to examples, estimate visual semantic similarity, retrieve matching examples across languages and modalities, group similar images, match visual content to questions, estimate visual semantic similarity on MIEB Multilingual · mean over tasks in 41 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish; tasks receive equal weight MTEB 65.1 #2 of 37Mean over task types · multilingual (41 languages) Embeddings retrieve matching examples across modalities, classify images, match queries to document content, distinguish changes in how objects and attributes are combined, assign unseen category labels to examples, estimate visual semantic similarity, retrieve matching examples across languages and modalities, group similar images, match visual content to questions, estimate visual semantic similarity on MIEB Multilingual · mean over task types in 41 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish; task types receive equal weight MTEB 65.1 #2 of 37Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MIEB Multilingual · Any-to-any Retrieval in English MTEB 37.9 #13 of 37
ViDoRev3 · Mean over tasks · multilingual (6 languages) Embeddings match queries to document content on ViDoRe v3 · mean over tasks in English, French, German, Italian, Portuguese, Spanish; tasks receive equal weight MTEB 45.6 #34 of 52
MIEB ImgVisual semantic similarity (English) · English Embeddings estimate visual semantic similarity on MIEB Img · Visual STS (English) in English MTEB 80.3 #1 of 46+3 versions & slices Image Classification · English Embeddings classify images on MIEB Img · Image Classification in English MTEB 75.3 #22 of 45Image Clustering · English Embeddings group similar images on MIEB Img · Image Clustering in English MTEB 86 #3 of 45Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MIEB Img · Any-to-any Retrieval in English MTEB 37.3 #18 of 42
MVEB text videov1 · Video Clustering · English Embeddings group similar videos on MVEB Text Video v1 · Video Clustering in English MTEB 7.1 #21 of 27+7 versions & slices v1 · Video Pair Classification · English Embeddings classify relationships between video pairs on MVEB Text Video v1 · Video Pair Classification in English MTEB 85.6 #8 of 27v1 · Video Centric QA · English Embeddings match video content to questions on MVEB Text Video v1 · Video Centric QA in English MTEB 26.3 #11 of 25v1 · Video Classification · multilingual (16 languages) Embeddings classify videos on MVEB Text Video v1 · Video Classification in Bosnian, Breton, Chinese, English, Finnish, French, German, Hindi, Italian, Japanese, Korean, Persian, Portuguese, Russian, Spanish, Telugu MTEB 41.6 #20 of 25v1 · Video Zero-shot Classification · English Embeddings classify videos using unseen labels on MVEB Text Video v1 · Video Zero-shot Classification in English MTEB 53.2 #13 of 25v1 · Mean over tasks · multilingual (16 languages) Embeddings classify videos, classify videos using unseen labels, retrieve matching examples across modalities, classify relationships between video pairs, group similar videos, match video content to questions on MVEB Text Video v1 · mean over tasks in Bosnian, Breton, Chinese, English, Finnish, French, German, Hindi, Italian, Japanese, Korean, Persian, Portuguese, Russian, Spanish, Telugu; tasks receive equal weight MTEB 48.4 #16 of 24v1 · Mean over task types · multilingual (16 languages) Embeddings classify videos, classify videos using unseen labels, retrieve matching examples across modalities, classify relationships between video pairs, group similar videos, match video content to questions on MVEB Text Video v1 · mean over task types in Bosnian, Breton, Chinese, English, Finnish, French, German, Hindi, Italian, Japanese, Korean, Persian, Portuguese, Russian, Spanish, Telugu; task types receive equal weight MTEB 44.4 #13 of 24v1 · Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MVEB Text Video v1 · Any-to-any Retrieval in English MTEB 52.6 #16 of 24
MVEBv1 · Video Centric QA · English Embeddings match video content to questions on MVEB v1 · Video Centric QA in English MTEB 46.6 #10 of 26+7 versions & slices v1 · Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MVEB v1 · Any-to-any Retrieval in English MTEB 38.5 #13 of 17v1 · Video Zero-shot Classification · English Embeddings classify videos using unseen labels on MVEB v1 · Video Zero-shot Classification in English MTEB 51.7 #6 of 17v1 · Mean over tasks · multilingual (16 languages) Embeddings classify videos, classify videos using unseen labels, retrieve matching examples across modalities, match video content to questions, classify relationships between video pairs, group similar videos on MVEB v1 · mean over tasks in Bosnian, Breton, Chinese, English, Finnish, French, German, Hindi, Italian, Japanese, Korean, Persian, Portuguese, Russian, Spanish, Telugu; tasks receive equal weight MTEB 45.5 #12 of 16v1 · Mean over task types · multilingual (16 languages) Embeddings classify videos, classify videos using unseen labels, retrieve matching examples across modalities, match video content to questions, classify relationships between video pairs, group similar videos on MVEB v1 · mean over task types in Bosnian, Breton, Chinese, English, Finnish, French, German, Hindi, Italian, Japanese, Korean, Persian, Portuguese, Russian, Spanish, Telugu; task types receive equal weight MTEB 47.9 #8 of 16v1 · Video Classification · multilingual (16 languages) Embeddings classify videos on MVEB v1 · Video Classification in Bosnian, Breton, Chinese, English, Finnish, French, German, Hindi, Italian, Japanese, Korean, Persian, Portuguese, Russian, Spanish, Telugu MTEB 52.4 #10 of 16v1 · Video Clustering · English Embeddings group similar videos on MVEB v1 · Video Clustering in English MTEB 18.2 #12 of 16v1 · Video Pair Classification · English Embeddings classify relationships between video pairs on MVEB v1 · Video Pair Classification in English MTEB 79.9 #2 of 16
MVEB videov1 · Mean over tasks · multilingual (16 languages) Embeddings classify relationships between video pairs, classify videos on MVEB Video v1 · mean over tasks in Bosnian, Breton, Chinese, English, Finnish, French, German, Hindi, Italian, Japanese, Korean, Persian, Portuguese, Russian, Spanish, Telugu; tasks receive equal weight MTEB 55.2 #17 of 25+3 versions & slices v1 · Mean over task types · multilingual (16 languages) Embeddings classify relationships between video pairs, classify videos on MVEB Video v1 · mean over task types in Bosnian, Breton, Chinese, English, Finnish, French, German, Hindi, Italian, Japanese, Korean, Persian, Portuguese, Russian, Spanish, Telugu; task types receive equal weight MTEB 59.7 #11 of 25v1 · Video Classification · multilingual (16 languages) Embeddings classify videos on MVEB Video v1 · Video Classification in Bosnian, Breton, Chinese, English, Finnish, French, German, Hindi, Italian, Japanese, Korean, Persian, Portuguese, Russian, Spanish, Telugu MTEB 46.2 #18 of 25v1 · Video Pair Classification · English Embeddings classify relationships between video pairs on MVEB Video v1 · Video Pair Classification in English MTEB 73.2 #7 of 25
MTEB Englishv2 · Classification · English Embeddings assign examples to categories in English MTEB 90.8 #2 of 13+6 versions & slices v2 · Reranking · English Embeddings reorder candidate documents by relevance in English MTEB 49.4 #2 of 13v2 · Pair Classification · English Embeddings classify relationships between pairs in English MTEB 85 #4 of 13v2 · STS · English Embeddings estimate semantic similarity between pairs in English MTEB 88.1 #2 of 12v2 · Retrieval · English Embeddings rank relevant documents for queries in English MTEB 60.1 #2 of 12v2 · Summarization · English Embeddings match summaries to their source meaning in English MTEB 31.8 #6 of 11v2 · Clustering · English Embeddings group similar examples in English MTEB 54.7 #2 of 11
MTEB Medicalv1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English MTEB 42.5 #2 of 11+1 versions & slices v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese MTEB 83.4 #4 of 5
RTEB German betaMean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight MTEB 63.6 #6 of 8
RTEB Finnish betaMean over tasks · English Embeddings rank relevant documents for queries on RTEB Finnish Beta · mean over tasks in English; tasks receive equal weight MTEB 66.1 #7 of 8
RTEB Law betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight MTEB 56.4 #3 of 8
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 86 #2 of 6+2 versions & slices v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 52 #1 of 3v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish MTEB 68 #2 of 2
RTEB French betaMean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight MTEB 51.3 #5 of 6
RTEB Health betaMean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 62.3 #4 of 6
MTEB Mandarin Chinesev1 · Clustering · Mandarin Chinese Embeddings group similar examples on MTEB Chinese v1 · Clustering in Mandarin Chinese MTEB 60.2 #3 of 5+4 versions & slices v1 · Pair Classification · Mandarin Chinese Embeddings classify relationships between pairs on MTEB Chinese v1 · Pair Classification in Mandarin Chinese MTEB 70.7 #4 of 5v1 · STS · Mandarin Chinese Embeddings estimate semantic similarity between pairs on MTEB Chinese v1 · STS in Mandarin Chinese MTEB 54.8 #5 of 5v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Chinese v1 · Reranking in Mandarin Chinese MTEB 66.5 #4 of 4v1 · Classification · Mandarin Chinese Embeddings assign examples to categories on MTEB Chinese v1 · Classification in Mandarin Chinese MTEB 63.3 #2 of 3
MTEB Europev1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 90.9 #2 of 5+6 versions & slices v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian MTEB 48.2 #1 of 4v1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English MTEB 1.3 #1 of 4v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 31.8 #1 of 4v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish MTEB 60.9 #1 of 4v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish MTEB 91.5 #1 of 2v1 · STS · multilingual (8 languages) Embeddings estimate semantic similarity between pairs on MTEB Europe v1 · STS in Dutch, English, Finnish, French, German, Italian, Polish, Spanish MTEB 81.7 #2 of 2
MTEB Indicv1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu MTEB 47.8 #2 of 5+4 versions & slices v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 48.1 #2 of 4v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi MTEB 79.8 #1 of 4v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi MTEB 87 #1 of 4v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu MTEB 70.5 #1 of 1
MTEB multilingualv2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi MTEB 69.7 #3 of 5+10 versions & slices v2 · Mean over tasks · multilingual (1037 languages) Embeddings group similar examples, estimate semantic similarity between pairs, assign examples to categories, rank relevant documents for queries, assign multiple labels to each example, find translated sentence pairs, rerank documents according to instructions, reorder candidate documents by relevance, classify relationships between pairs on MTEB Multilingual v2 · mean over tasks in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; tasks receive equal weight MTEB 67 #1 of 4v2 · Mean over task types · multilingual (1037 languages) Embeddings group similar examples, estimate semantic similarity between pairs, assign examples to categories, rank relevant documents for queries, assign multiple labels to each example, find translated sentence pairs, rerank documents according to instructions, reorder candidate documents by relevance, classify relationships between pairs on MTEB Multilingual v2 · mean over task types in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; task types receive equal weight MTEB 58.9 #1 of 4v2 · Classification · multilingual (119 languages) Embeddings assign examples to categories on MTEB Multilingual v2 · Classification in 119 languages including Achinese, Afrikaans, Albanian, Algerian Arabic, Amharic, Arabic, Armenian, Assamese MTEB 71.3 #1 of 4v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian MTEB 53.4 #1 of 4v2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English MTEB 1.3 #1 of 4v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish MTEB 42 #1 of 4v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French MTEB 82.9 #1 of 4v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French MTEB 65.7 #1 of 4v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali MTEB 64.9 #1 of 4v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English MTEB 78.8 #1 of 4
FollowIRMean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight MTEB 1.3 #1 of 4+2 versions & slices Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight MTEB 1.3 #1 of 4Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English MTEB 1.3 #1 of 4
MTEB Frenchv1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French MTEB 70.5 #1 of 4+2 versions & slices v1 · Reranking · French Embeddings reorder candidate documents by relevance on MTEB French v1 · Reranking in French MTEB 86.5 #1 of 2v1 · Summarization · French Embeddings match summaries to their source meaning on MTEB French v1 · Summarization in French MTEB 28.8 #2 of 2
MTEB Portuguesev1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese MTEB 21.3 #3 of 4+1 versions & slices v1 · Classification · Portuguese Embeddings assign examples to categories on MTEB Portuguese v1 · Classification in Portuguese MTEB 69 #1 of 2
MTEB Russianv1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian MTEB 67.3 #1 of 4+2 versions & slices v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian MTEB 61.4 #1 of 2v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian MTEB 41.7 #2 of 2
MTEB Spanishv1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish MTEB 77.3 #1 of 4+7 versions & slices v1 · Mean over tasks · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, group similar examples, rank relevant documents for queries, classify relationships between pairs, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over tasks in English, Spanish; tasks receive equal weight MTEB 68.2 #1 of 2v1 · Mean over task types · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, group similar examples, rank relevant documents for queries, classify relationships between pairs, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over task types in English, Spanish; task types receive equal weight MTEB 68.4 #1 of 2v1 · Classification · Spanish Embeddings assign examples to categories on MTEB Spanish v1 · Classification in Spanish MTEB 80.3 #1 of 2v1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish MTEB 48.8 #2 of 2v1 · Reranking · Spanish Embeddings reorder candidate documents by relevance on MTEB Spanish v1 · Reranking in Spanish MTEB 64.6 #1 of 2v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Spanish v1 · Retrieval in English, Spanish MTEB 56.7 #1 of 2v1 · STS · multilingual (2 languages) Embeddings estimate semantic similarity between pairs on MTEB Spanish v1 · STS in English, Spanish MTEB 82.5 #1 of 2
MTEB Thaiv1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai MTEB 55.2 #3 of 4+6 versions & slices v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai MTEB 79.2 #1 of 4v1 · Mean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries, assign examples to categories, classify relationships between pairs, group similar examples, reorder candidate documents by relevance on MTEB Thai v1 · mean over tasks in English, Thai; tasks receive equal weight MTEB 64.2 #1 of 2v1 · Mean over task types · multilingual (2 languages) Embeddings rank relevant documents for queries, assign examples to categories, classify relationships between pairs, group similar examples, reorder candidate documents by relevance on MTEB Thai v1 · mean over task types in English, Thai; task types receive equal weight MTEB 63.9 #1 of 2v1 · Classification · Thai Embeddings assign examples to categories on MTEB Thai v1 · Classification in Thai MTEB 68.2 #1 of 2v1 · Reranking · Thai Embeddings reorder candidate documents by relevance on MTEB Thai v1 · Reranking in Thai MTEB 52.2 #2 of 2v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Thai v1 · Retrieval in English, Thai MTEB 64.5 #1 of 2
LongEmbedMean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight MTEB 66.4 #2 of 3+2 versions & slices Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight MTEB 66.4 #2 of 3Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English MTEB 66.4 #2 of 3
JMTEBv2 · Clustering · Japanese Embeddings group similar examples on jMTEB v2 · Clustering in Japanese MTEB 51.9 #2 of 2+1 versions & slices v2 · STS · Japanese Embeddings estimate semantic similarity between pairs on jMTEB v2 · STS in Japanese MTEB 82.5 #1 of 2
MTEB Germanv1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German MTEB 58.7 #1 of 2
MTEB Persianv2 · Bitext Mining · Persian Embeddings find translated sentence pairs on MTEB Persian v2 · Bitext Mining in Persian MTEB 57.3 #1 of 2+3 versions & slices v2 · Clustering · Persian Embeddings group similar examples on MTEB Persian v2 · Clustering in Persian MTEB 70.7 #1 of 2v2 · Pair Classification · Persian Embeddings classify relationships between pairs on MTEB Persian v2 · Pair Classification in Persian MTEB 83.4 #2 of 2v2 · STS · Persian Embeddings estimate semantic similarity between pairs on MTEB Persian v2 · STS in Persian MTEB 80 #1 of 2
MTEB Koreanv2 · Classification · Korean Embeddings assign examples to categories on MTEB Korean v2 · Classification in Korean MTEB 33.3 #2 of 2+3 versions & slices v2 · Clustering · Korean Embeddings group similar examples on MTEB Korean v2 · Clustering in Korean MTEB 74.4 #1 of 2v2 · Pair Classification · Korean Embeddings classify relationships between pairs on MTEB Korean v2 · Pair Classification in Korean MTEB 70.3 #1 of 2v2 · STS · Korean Embeddings estimate semantic similarity between pairs on MTEB Korean v2 · STS in Korean MTEB 87.5 #1 of 2
MTEB Polishv1 · Clustering · Polish Embeddings group similar examples on MTEB Polish v1 · Clustering in Polish MTEB 49.6 #1 of 2+1 versions & slices v1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish MTEB 86.9 #2 of 2
No benchmark matches
