Benchmark By Score Rank
MIEB liteDocument Understanding · English Embeddings match queries to document content on MIEB Lite · Document Understanding in English MTEB 1.1 #88 of 89+11 versions & slices Visual semantic similarity (multilingual) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Lite · Visual STS (multilingual) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 31.9 #35 of 56Visual semantic similarity (English) · English Embeddings estimate visual semantic similarity on MIEB Lite · Visual STS (English) in English MTEB 60.1 #41 of 54Image Classification · English Embeddings classify images on MIEB Lite · Image Classification in English MTEB 61.8 #50 of 53Image Clustering · English Embeddings group similar images on MIEB Lite · Image Clustering in English MTEB 64.6 #41 of 53Any-to-any Multilingual Retrieval · multilingual (40 languages) Embeddings retrieve matching examples across languages and modalities on MIEB Lite · Any-to-any Multilingual Retrieval in 40 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish MTEB 0.4 #47 of 48Vision Centric QA · English Embeddings match visual content to questions on MIEB Lite · Vision Centric QA in English MTEB 51 #26 of 48Mean over tasks · multilingual (41 languages) Embeddings match visual content to questions, retrieve matching examples across modalities, match queries to document content, assign unseen category labels to examples, distinguish changes in how objects and attributes are combined, classify images, retrieve matching examples across languages and modalities, group similar images, estimate visual semantic similarity, estimate visual semantic similarity on MIEB Lite · mean over tasks in 41 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish; tasks receive equal weight MTEB 31.1 #46 of 47Mean over task types · multilingual (41 languages) Embeddings match visual content to questions, retrieve matching examples across modalities, match queries to document content, assign unseen category labels to examples, distinguish changes in how objects and attributes are combined, classify images, retrieve matching examples across languages and modalities, group similar images, estimate visual semantic similarity, estimate visual semantic similarity on MIEB Lite · mean over task types in 41 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish; task types receive equal weight MTEB 31.1 #46 of 47Any-to-any Retrieval · English Embeddings retrieve matching examples across modalities on MIEB Lite · Any-to-any Retrieval in English MTEB 13 #46 of 47Compositionality · English Embeddings distinguish changes in how objects and attributes are combined on MIEB Lite · Compositionality in English MTEB 23.2 #47 of 47Zero-shot Classification · English Embeddings assign unseen category labels to examples on MIEB Lite · Zero-shot Classification in English MTEB 3.8 #46 of 47
MIEB EnglishDocument Understanding · English Embeddings match queries to document content on MIEB English · Document Understanding in English MTEB 0.8 #81 of 81+6 versions & slices Visual semantic similarity (English) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB English · Visual STS (English) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 62.2 #31 of 46Image Classification · English Embeddings classify images on MIEB English · Image Classification in English MTEB 66.4 #39 of 45Image Clustering · English Embeddings group similar images on MIEB English · Image Clustering in English MTEB 73.7 #32 of 45Vision Centric QA · English Embeddings match visual content to questions on MIEB English · Vision Centric QA in English MTEB 49.1 #19 of 40Compositionality · English Embeddings distinguish changes in how objects and attributes are combined on MIEB English · Compositionality in English MTEB 27.1 #39 of 39Zero-shot Classification · English Embeddings assign unseen category labels to examples on MIEB English · Zero-shot Classification in English MTEB 9.2 #39 of 39
MIEB multilingualDocument Understanding · English Embeddings match queries to document content on MIEB Multilingual · Document Understanding in English MTEB 0.8 #81 of 81+8 versions & slices Visual semantic similarity (multilingual) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Multilingual · Visual STS (multilingual) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 31.9 #35 of 56Visual semantic similarity (English) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Multilingual · Visual STS (English) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 62.2 #31 of 46Image Classification · English Embeddings classify images on MIEB Multilingual · Image Classification in English MTEB 66.4 #39 of 45Image Clustering · English Embeddings group similar images on MIEB Multilingual · Image Clustering in English MTEB 73.7 #32 of 45Vision Centric QA · English Embeddings match visual content to questions on MIEB Multilingual · Vision Centric QA in English MTEB 49.1 #19 of 40Any-to-any Multilingual Retrieval · multilingual (40 languages) Embeddings retrieve matching examples across languages and modalities on MIEB Multilingual · Any-to-any Multilingual Retrieval in 40 languages including Arabic, Bengali, Bulgarian, Chinese, Croatian, Cusco Quechua, Czech, Danish MTEB 0.3 #38 of 39Compositionality · English Embeddings distinguish changes in how objects and attributes are combined on MIEB Multilingual · Compositionality in English MTEB 27.1 #39 of 39Zero-shot Classification · English Embeddings assign unseen category labels to examples on MIEB Multilingual · Zero-shot Classification in English MTEB 9.2 #39 of 39
MIEB ImgVisual semantic similarity (multilingual) · multilingual (13 languages) Embeddings estimate visual semantic similarity on MIEB Img · Visual STS (multilingual) in Arabic, Dutch, English, French, German, Italian, Korean, Mandarin Chinese, Polish, Portuguese, Russian, Spanish, Turkish MTEB 36.6 #29 of 50+3 versions & slices Visual semantic similarity (English) · English Embeddings estimate visual semantic similarity on MIEB Img · Visual STS (English) in English MTEB 60.5 #30 of 46Image Classification · English Embeddings classify images on MIEB Img · Image Classification in English MTEB 66.4 #39 of 45Image Clustering · English Embeddings group similar images on MIEB Img · Image Clustering in English MTEB 73.7 #32 of 45
No benchmark matches
BetterJina Embeddings v5 Omni NanounstatedOpen+22%—$0.02Memory (4-bit): 0.3 GB → 0.6 GB