S

Blip2 Opt 2.7B

Mar 2024
SBlip2 Opt 2.7B
Compare in
on
self-host onlyprice
11.9MIEB lite
Mar 2024released
2,560Dimensions
enLanguages

Ranking?

Full ranking →
1Argus Colqwen3.5 9B v089.82Nemotron Colembed VL 8B v289.53Argus Colqwen3.5 4B v089.54VultronRetrieverPrime Qwen3.5 8B88.95VultronRetrieverCore Qwen3.5 4.5B88.9
···
83Clip Vit Base Patch3212.484Blip2 Opt 2.7B11.985CLIP ViT B 32 DataComp.XL S13B B90K11.7

Strong at

C
Embeddings & Retrieval#84 of 89

Alternatives?

ModelScoreCostPriceWhat changes
BetterJina Embeddings v5 Omni NanounstatedOpen×6.2—$0.02Languages: not verifiedDOpenArgus Colqwen3.5 9B v0unstated×7.5——Memory (4-bit): 2.2 GB → 5.3 GBBetterEmbeddingGemma 2unstatedOpen×5.6—$0.02Languages: not verifiedBetterJina Embeddings v4unstatedOpen×7.3—$0.05Languages: not verified+1BetterJina Embeddings v5 Omni SmallunstatedOpen×6.2—$0.05Languages: not verified

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
MIEB English · Mean over tasks · multilingual (13 languages)45.2#36
MIEB English · Mean over task types · multilingual (13 languages)45.2#36
MIEB English · Document Understanding · English12.3#77
MIEB English · Zero-shot Classification · English48.8#30
MIEB English · Any-to-any Retrieval · English26.7#36
MIEB English · Visual semantic similarity (English) · multilingual (13 languages)42.8#39
MIEB English · Image Classification · English72.9#27
MIEB English · Compositionality · English31#37
MIEB English · Vision Centric QA · English53.1#7
MIEB English · Image Clustering · English74#30
MIEB Img · Mean over tasks · multilingual (13 languages)48.5#33
MIEB Img · Mean over task types · multilingual (13 languages)48.5#33
MIEB Img · Image Classification · English72.9#27
MIEB Img · Any-to-any Retrieval · English29#36
MIEB Img · Visual semantic similarity (English) · English41.4#39
MIEB Img · Visual semantic similarity (multilingual) · multilingual (13 languages)25.3#43
MIEB Img · Image Clustering · English74#30
MIEB lite · Mean over tasks · multilingual (41 languages)34.6#44
MIEB lite · Mean over task types · multilingual (41 languages)34.6#44
MIEB lite · Vision Centric QA · English55.4#14
MIEB lite · Any-to-any Retrieval · English19.3#44
MIEB lite · Document Understanding · English11.9#84
MIEB lite · Zero-shot Classification · English43.7#36
MIEB lite · Compositionality · English24#44
MIEB lite · Image Classification · English64.1#45
MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages)13#43
MIEB lite · Image Clustering · English47.1#52
MIEB lite · Visual semantic similarity (English) · English45.3#47
MIEB lite · Visual semantic similarity (multilingual) · multilingual (13 languages)21.8#49
MIEB multilingual · Mean over tasks · multilingual (41 languages)39.7#35
MIEB multilingual · Mean over task types · multilingual (41 languages)39.7#35
MIEB multilingual · Zero-shot Classification · English48.8#30
MIEB multilingual · Image Classification · English72.9#27
MIEB multilingual · Document Understanding · English12.3#77
MIEB multilingual · Any-to-any Retrieval · English26.7#36
MIEB multilingual · Compositionality · English31#37
MIEB multilingual · Vision Centric QA · English53.1#7
MIEB multilingual · Visual semantic similarity (English) · multilingual (13 languages)42.8#39
MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages)21.8#49
MIEB multilingual · Any-to-any Multilingual Retrieval · multilingual (40 languages)13.9#34
MIEB multilingual · Image Clustering · English74#30

FAQ

How much does Blip2 Opt 2.7B cost?›

There is no per-unit API price: self-host only.

Is Blip2 Opt 2.7B free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Blip2 Opt 2.7B, and what is it best at?›

#84 of 89 in Multimodal.

Is Blip2 Opt 2.7B better than Clip Vit Base Patch32?›

On MIEB lite · Document Understanding · English, Blip2 Opt 2.7B scores 11.9 vs 12.4 — about the same.

When was Blip2 Opt 2.7B released? Is there a newer version?›

Released 2024-03-22. It is the current version in its line.

Is Blip2 Opt 2.7B open source?›

Yes, the weights are open (MIT licence).

Can I run Blip2 Opt 2.7B locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Blip2 Opt 2.7B?›

Blip2 Opt 2.7B is an open-weights embeddings & retrieval model from Salesforce, released Mar 2024.

What are the best alternatives to Blip2 Opt 2.7B?›

Jina Embeddings v5 Omni Nano (better), Argus Colqwen3.5 9B v0 (open weights).