T

VLM2Vec Full

Oct 2024
TVLM2Vec Full
Compare in
on
self-host onlyprice
42.8MIEB lite
Oct 2024released
3,072Dimensions
131K tokensMax input
enLanguages

Ranking?

Full ranking →
1DNA VL STEER 2B712E5 V66.63Jina Embeddings v5 Omni Small62.84Siglip Base Patch16 256 Multilingual59.25Voyage Multimodal 358.9
···
13Siglip So400m Patch14 38440.214VLM2Vec Full3515VLM2Vec LoRA34.9

Strong at

C
Embeddings & Retrieval#58 of 89

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
MIEB English · Mean over tasks · multilingual (13 languages)53.3#23
MIEB English · Mean over task types · multilingual (13 languages)53.3#23
MIEB English · Document Understanding · English49.8#51
MIEB English · Zero-shot Classification · English46.3#33
MIEB English · Any-to-any Retrieval · English27.6#34
MIEB English · Visual semantic similarity (English) · multilingual (13 languages)72.6#6
MIEB English · Image Classification · English62#43
MIEB English · Compositionality · English35.4#32
MIEB English · Vision Centric QA · English62.1#2
MIEB English · Image Clustering · English70.7#36
MIEB Img · Mean over tasks · multilingual (13 languages)55.7#22
MIEB Img · Mean over task types · multilingual (13 languages)55.7#22
MIEB Img · Image Classification · English62#43
MIEB Img · Any-to-any Retrieval · English27.7#40
MIEB Img · Visual semantic similarity (English) · English70.2#7
MIEB Img · Visual semantic similarity (multilingual) · multilingual (13 languages)48#11
MIEB Img · Image Clustering · English70.7#36
MIEB lite · Mean over tasks · multilingual (41 languages)45.9#31
MIEB lite · Mean over task types · multilingual (41 languages)45.9#31
MIEB lite · Vision Centric QA · English65.3#6
MIEB lite · Any-to-any Retrieval · English20.9#43
MIEB lite · Document Understanding · English42.8#58
MIEB lite · Zero-shot Classification · English32.1#43
MIEB lite · Compositionality · English30.2#38
MIEB lite · Image Classification · English64.8#40
MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages)24.9#24
MIEB lite · Image Clustering · English65.4#39
MIEB lite · Visual semantic similarity (English) · English70.9#18
MIEB lite · Visual semantic similarity (multilingual) · multilingual (13 languages)42.2#16
MIEB multilingual · Mean over tasks · multilingual (41 languages)50.4#21
MIEB multilingual · Mean over task types · multilingual (41 languages)50.4#21
MIEB multilingual · Zero-shot Classification · English46.3#33
MIEB multilingual · Image Classification · English62#43
MIEB multilingual · Document Understanding · English49.8#51
MIEB multilingual · Any-to-any Retrieval · English27.6#34
MIEB multilingual · Compositionality · English35.4#32
MIEB multilingual · Vision Centric QA · English62.1#2
MIEB multilingual · Visual semantic similarity (English) · multilingual (13 languages)72.6#6
MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages)42.2#16
MIEB multilingual · Any-to-any Multilingual Retrieval · multilingual (40 languages)35#14
MIEB multilingual · Image Clustering · English70.7#36
ViDoRe v1&v2 · Mean over tasks · multilingual (4 languages)44.7#46

FAQ

How much does VLM2Vec Full cost?›

There is no per-unit API price: self-host only.

Is VLM2Vec Full free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is VLM2Vec Full, and what is it best at?›

#58 of 89 in Multimodal.

Is VLM2Vec Full better than Siglip So400m Patch14 384?›

On MIEB multilingual · Any-to-any Multilingual Retrieval · multilingual (40 languages), VLM2Vec Full scores 35 vs 40.2 — lower.

When was VLM2Vec Full released? Is there a newer version?›

Released 2024-10-08. It is the current version in its line.

Is VLM2Vec Full open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run VLM2Vec Full locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is VLM2Vec Full?›

VLM2Vec Full is an open-weights embeddings & retrieval model from TIGER-Lab, released Oct 2024.

What are the best alternatives to VLM2Vec Full?›

Jina Embeddings v5 Omni Nano (better), DNA VL STEER 2B (open weights).