Benchmark By Score Rank
MIEB liteDocument Understanding · English Embeddings match queries to document content on MIEB Lite · Document Understanding in English MTEB 79.8 #35 of 89+11 versions & slices Visual semantic similarity (multilingual) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Lite · Visual STS (multilingual) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 70.4 #7 of 56Visual semantic similarity (English) · English Embeddings estimate visual semantic similarity on MIEB Lite · Visual STS (English) in English MTEB 84.2 #3 of 54Image Classification · English Embeddings classify images on MIEB Lite · Image Classification in English MTEB 69.3 #28 of 53Image Clustering · English Embeddings group similar images on MIEB Lite · Image Clustering in English MTEB 76.6 #16 of 53Any-to-any Multilingual Retrieval · multilingual (40 languages) Embeddings retrieve matching examples across languages and modalities on MIEB Lite · Any-to-any Multilingual Retrieval in 40 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish MTEB 49 #12 of 48Vision Centric QA · English Embeddings match visual content to questions on MIEB Lite · Vision Centric QA in English MTEB 50.1 #28 of 48Mean over tasks · multilingual (41 languages) Embeddings match visual content to questions, retrieve matching examples across modalities, match queries to document content, assign unseen category labels to examples, distinguish changes in how objects and attributes are combined, classify images, retrieve matching examples across languages and modalities, group similar images, estimate visual semantic similarity, estimate visual semantic similarity on MIEB Lite · mean over tasks in 41 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish; tasks receive equal weight MTEB 59.7 #7 of 47Mean over task types · multilingual (41 languages) Embeddings match visual content to questions, retrieve matching examples across modalities, match queries to document content, assign unseen category labels to examples, distinguish changes in how objects and attributes are combined, classify images, retrieve matching examples across languages and modalities, group similar images, estimate visual semantic similarity, estimate visual semantic similarity on MIEB Lite · mean over task types in 41 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish; task types receive equal weight MTEB 59.7 #7 of 47Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MIEB Lite · Any-to-any Retrieval in English MTEB 33.2 #9 of 47Compositionality · English Embeddings distinguish changes in how objects and attributes are combined on MIEB Lite · Compositionality in English MTEB 35.8 #16 of 47Zero-shot Classification · English Embeddings assign unseen category labels to examples on MIEB Lite · Zero-shot Classification in English MTEB 48.6 #34 of 47
MIEB EnglishDocument Understanding · English Embeddings match queries to document content on MIEB English · Document Understanding in English MTEB 83.9 #36 of 81+9 versions & slices Visual semantic similarity (English) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB English · Visual STS (English) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 81.8 #1 of 46Image Classification · English Embeddings classify images on MIEB English · Image Classification in English MTEB 71.3 #29 of 45Image Clustering · English Embeddings group similar images on MIEB English · Image Clustering in English MTEB 82.4 #11 of 45Vision Centric QA · English Embeddings match visual content to questions on MIEB English · Vision Centric QA in English MTEB 48.6 #20 of 40Compositionality · English Embeddings distinguish changes in how objects and attributes are combined on MIEB English · Compositionality in English MTEB 43.5 #9 of 39Zero-shot Classification · English Embeddings assign unseen category labels to examples on MIEB English · Zero-shot Classification in English MTEB 58.2 #20 of 39Mean over tasks · multilingual (13 languages) Embeddings match queries to document content, assign unseen category labels to examples, retrieve matching examples across modalities, estimate visual semantic similarity, classify images, distinguish changes in how objects and attributes are combined, match visual content to questions, group similar images on MIEB English · mean over tasks in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish; tasks receive equal weight MTEB 63.6 #3 of 37Mean over task types · multilingual (13 languages) Embeddings match queries to document content, assign unseen category labels to examples, retrieve matching examples across modalities, estimate visual semantic similarity, classify images, distinguish changes in how objects and attributes are combined, match visual content to questions, group similar images on MIEB English · mean over task types in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish; task types receive equal weight MTEB 63.6 #3 of 37Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MIEB English · Any-to-any Retrieval in English MTEB 38.8 #8 of 37
MIEB multilingualDocument Understanding · English Embeddings match queries to document content on MIEB Multilingual · Document Understanding in English MTEB 83.9 #36 of 81+11 versions & slices Visual semantic similarity (multilingual) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Multilingual · Visual STS (multilingual) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 70.4 #7 of 56Visual semantic similarity (English) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Multilingual · Visual STS (English) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 81.8 #1 of 46Image Classification · English Embeddings classify images on MIEB Multilingual · Image Classification in English MTEB 71.3 #29 of 45Image Clustering · English Embeddings group similar images on MIEB Multilingual · Image Clustering in English MTEB 82.4 #11 of 45Vision Centric QA · English Embeddings match visual content to questions on MIEB Multilingual · Vision Centric QA in English MTEB 48.6 #20 of 40Any-to-any Multilingual Retrieval · multilingual (40 languages) Embeddings retrieve matching examples across languages and modalities on MIEB Multilingual · Any-to-any Multilingual Retrieval in 40 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish MTEB 58.9 #5 of 39Compositionality · English Embeddings distinguish changes in how objects and attributes are combined on MIEB Multilingual · Compositionality in English MTEB 43.5 #9 of 39Zero-shot Classification · English Embeddings assign unseen category labels to examples on MIEB Multilingual · Zero-shot Classification in English MTEB 58.2 #20 of 39Mean over tasks · multilingual (41 languages) Embeddings assign unseen category labels to examples, classify images, match queries to document content, retrieve matching examples across modalities, distinguish changes in how objects and attributes are combined, match visual content to questions, estimate visual semantic similarity, estimate visual semantic similarity, retrieve matching examples across languages and modalities, group similar images on MIEB Multilingual · mean over tasks in 41 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish; tasks receive equal weight MTEB 63.8 #3 of 37Mean over task types · multilingual (41 languages) Embeddings assign unseen category labels to examples, classify images, match queries to document content, retrieve matching examples across modalities, distinguish changes in how objects and attributes are combined, match visual content to questions, estimate visual semantic similarity, estimate visual semantic similarity, retrieve matching examples across languages and modalities, group similar images on MIEB Multilingual · mean over task types in 41 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish; task types receive equal weight MTEB 63.8 #3 of 37Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MIEB Multilingual · Any-to-any Retrieval in English MTEB 38.8 #8 of 37
MIEB ImgVisual semantic similarity (multilingual) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Img · Visual STS (multilingual) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 73.1 #6 of 50+6 versions & slices Visual semantic similarity (English) · English Embeddings estimate visual semantic similarity on MIEB Img · Visual STS (English) in English MTEB 80.1 #2 of 46Image Classification · English Embeddings classify images on MIEB Img · Image Classification in English MTEB 71.3 #29 of 45Image Clustering · English Embeddings group similar images on MIEB Img · Image Clustering in English MTEB 82.4 #11 of 45Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MIEB Img · Any-to-any Retrieval in English MTEB 29.5 #34 of 42Mean over tasks · multilingual (13 languages) Embeddings classify images, retrieve matching examples across modalities, estimate visual semantic similarity, estimate visual semantic similarity, group similar images on MIEB Img · mean over tasks in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish; tasks receive equal weight MTEB 67.3 #2 of 40Mean over task types · multilingual (13 languages) Embeddings classify images, retrieve matching examples across modalities, estimate visual semantic similarity, estimate visual semantic similarity, group similar images on MIEB Img · mean over task types in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish; task types receive equal weight MTEB 67.3 #2 of 40
ViDoRe v1&v2Mean over tasks · multilingual (4 languages) Embeddings match queries to document content on ViDoRe v1 v2 · mean over tasks in English, French, German, Spanish; tasks receive equal weight MTEB 75.7 #36 of 49
MTEB Scandinavianv1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk MTEB 65.5 #6 of 6+2 versions & slices v1 · Classification · multilingual (6 languages) Embeddings assign examples to categories on MTEB Scandinavian v1 · Classification in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish MTEB 58.3 #1 of 1v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish MTEB 40 #1 of 1
JinaVDRMean over tasks · multilingual (20 languages) Embeddings match queries to document content on JinaVDR · mean over tasks in Arabic, Bengali, Burmese, Chinese, Dutch, English, French, German, Hindi, Hungarian, Indonesian, Italian, Japanese, Korean, Portuguese, Russian, Spanish, Thai, Urdu, Vietnamese; tasks receive equal weight MTEB 69.5 #3 of 5+2 versions & slices Mean over task types · multilingual (20 languages) Embeddings match queries to document content on JinaVDR · mean over task types in Arabic, Bengali, Burmese, Chinese, Dutch, English, French, German, Hindi, Hungarian, Indonesian, Italian, Japanese, Korean, Portuguese, Russian, Spanish, Thai, Urdu, Vietnamese; task types receive equal weight MTEB 69.5 #3 of 5Document Understanding · multilingual (20 languages) Embeddings match queries to document content on JinaVDR · Document Understanding in Arabic, Bengali, Burmese, Chinese, Dutch, English, French, German, Hindi, Hungarian, Indonesian, Italian, Japanese, Korean, Portuguese, Russian, Spanish, Thai, Urdu, Vietnamese MTEB 69.5 #3 of 5
No benchmark matches
CheaperJina Embeddings v5 Omni SmallunstatedOpensame-58%$0.05