S

Blip Image Captioning Large

Dec 2023
SBlip Image Captioning Large
Compare in
on
self-host onlyprice
1.1MIEB lite
Dec 2023released
768Dimensions
1K tokensMax input

Ranking?

Full ranking →
1E5 Omni 7B66.12EmbeddingGemma 264.63DNA VL STEER 2B63.74LCO Embedding Omni 7B62.35OmniEmbed v0.159.5
···
46Blip2 Opt 6.7B Coco10.647Blip Image Captioning Large0.448Blip Image Captioning Base0.3

Strong at

C
Embeddings & Retrieval#88 of 89

Alternatives?

ModelScoreCostPriceWhat changes
BetterEmbeddingGemma 2unstatedOpen×172.3—$0.02HOpenE5 Omni 7Bunstated×176.4——Memory (4-bit): 0.3 GB → 5.4 GBBetterJina Embeddings v5 Omni NanounstatedOpen×103.2—$0.02Memory (4-bit): 0.3 GB → 0.6 GBBetterJina Embeddings v5 Omni SmallunstatedOpen×143.2—$0.05Memory (4-bit): 0.3 GB → 1 GBBetterJina Clip v1Open×42.8—$0.05

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceBSD-3-Clausefree for commercial use

Benchmarks

in Embeddings & Retrieval
MIEB English · Document Understanding · English0.8#81
MIEB English · Zero-shot Classification · English9.2#39
MIEB English · Visual semantic similarity (English) · multilingual (13 languages)62.2#31
MIEB English · Image Classification · English66.4#39
MIEB English · Compositionality · English27.1#39
MIEB English · Vision Centric QA · English49.1#19
MIEB English · Image Clustering · English73.7#32
MIEB Img · Image Classification · English66.4#39
MIEB Img · Visual semantic similarity (English) · English60.5#30
MIEB Img · Visual semantic similarity (multilingual) · multilingual (13 languages)36.6#29
MIEB Img · Image Clustering · English73.7#32
MIEB lite · Mean over tasks · multilingual (41 languages)31.1#46
MIEB lite · Mean over task types · multilingual (41 languages)31.1#46
MIEB lite · Vision Centric QA · English51#26
MIEB lite · Any-to-any Retrieval · English13#46
MIEB lite · Document Understanding · English1.1#88
MIEB lite · Zero-shot Classification · English3.8#46
MIEB lite · Compositionality · English23.2#47
MIEB lite · Image Classification · English61.8#50
MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages)0.4#47
MIEB lite · Image Clustering · English64.6#41
MIEB lite · Visual semantic similarity (English) · English60.1#41
MIEB lite · Visual semantic similarity (multilingual) · multilingual (13 languages)31.9#35
MIEB multilingual · Zero-shot Classification · English9.2#39
MIEB multilingual · Image Classification · English66.4#39
MIEB multilingual · Document Understanding · English0.8#81
MIEB multilingual · Compositionality · English27.1#39
MIEB multilingual · Vision Centric QA · English49.1#19
MIEB multilingual · Visual semantic similarity (English) · multilingual (13 languages)62.2#31
MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages)31.9#35
MIEB multilingual · Any-to-any Multilingual Retrieval · multilingual (40 languages)0.3#38
MIEB multilingual · Image Clustering · English73.7#32

FAQ

How much does Blip Image Captioning Large cost?›

There is no per-unit API price: self-host only.

Is Blip Image Captioning Large free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Blip Image Captioning Large, and what is it best at?›

#88 of 89 in Multimodal.

Is Blip Image Captioning Large better than Blip2 Opt 6.7B Coco?›

On MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages), Blip Image Captioning Large scores 0.4 vs 10.6 — lower.

When was Blip Image Captioning Large released? Is there a newer version?›

Released 2023-12-07. It is the current version in its line.

Is Blip Image Captioning Large open source?›

Yes, the weights are open (bsd-3-clause licence).

Can I run Blip Image Captioning Large locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Blip Image Captioning Large?›

Blip Image Captioning Large is an open-weights embeddings & retrieval model from Salesforce, released Dec 2023.

What are the best alternatives to Blip Image Captioning Large?›

EmbeddingGemma 2 (better), E5 Omni 7B (open weights).