S

Blip Image Captioning Large

Dec 2023
SBlip Image Captioning Large
Compare in
on
self-host onlyprice
1.1MIEB lite
Dec 2023released
768Dimensions
1K tokensMax input

Ranking?

Full ranking →
1LCO Embedding Omni 7B82.42LCO Embedding Omni 3B79.53E5 Omni 7B77.34EmbeddingGemma 276.85E5 Omni 3B73.5
···
34Siglip Base Patch16 22433.535Blip Image Captioning Large31.936CLIP ViT G 14 Laion2B S34B B88K31.7

Strong at

C
Embeddings & Retrieval#88 of 89

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceBSD-3-Clausefree for commercial use

Benchmarks

in Embeddings & Retrieval
MIEB English · Document Understanding · English0.8#81
MIEB English · Zero-shot Classification · English9.2#39
MIEB English · Visual semantic similarity (English) · multilingual (13 languages)62.2#31
MIEB English · Image Classification · English66.4#39
MIEB English · Compositionality · English27.1#39
MIEB English · Vision Centric QA · English49.1#19
MIEB English · Image Clustering · English73.7#32
MIEB Img · Image Classification · English66.4#39
MIEB Img · Visual semantic similarity (English) · English60.5#30
MIEB Img · Visual semantic similarity (multilingual) · multilingual (13 languages)36.6#29
MIEB Img · Image Clustering · English73.7#32
MIEB lite · Mean over tasks · multilingual (41 languages)31.1#46
MIEB lite · Mean over task types · multilingual (41 languages)31.1#46
MIEB lite · Vision Centric QA · English51#26
MIEB lite · Any-to-any Retrieval · English13#46
MIEB lite · Document Understanding · English1.1#88
MIEB lite · Zero-shot Classification · English3.8#46
MIEB lite · Compositionality · English23.2#47
MIEB lite · Image Classification · English61.8#50
MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages)0.4#47
MIEB lite · Image Clustering · English64.6#41
MIEB lite · Visual semantic similarity (English) · English60.1#41
MIEB lite · Visual semantic similarity (multilingual) · multilingual (13 languages)31.9#35
MIEB multilingual · Zero-shot Classification · English9.2#39
MIEB multilingual · Image Classification · English66.4#39
MIEB multilingual · Document Understanding · English0.8#81
MIEB multilingual · Compositionality · English27.1#39
MIEB multilingual · Vision Centric QA · English49.1#19
MIEB multilingual · Visual semantic similarity (English) · multilingual (13 languages)62.2#31
MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages)31.9#35
MIEB multilingual · Any-to-any Multilingual Retrieval · multilingual (40 languages)0.3#38
MIEB multilingual · Image Clustering · English73.7#32

FAQ

How much does Blip Image Captioning Large cost?›

There is no per-unit API price: self-host only.

Is Blip Image Captioning Large free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Blip Image Captioning Large, and what is it best at?›

#88 of 89 in Multimodal.

Is Blip Image Captioning Large better than Siglip Base Patch16 224?›

On MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages), Blip Image Captioning Large scores 31.9 vs 33.5 — lower.

When was Blip Image Captioning Large released? Is there a newer version?›

Released 2023-12-07. It is the current version in its line.

Is Blip Image Captioning Large open source?›

Yes, the weights are open (bsd-3-clause licence).

Can I run Blip Image Captioning Large locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Blip Image Captioning Large?›

Blip Image Captioning Large is an open-weights embeddings & retrieval model from Salesforce, released Dec 2023.

What are the best alternatives to Blip Image Captioning Large?›

EmbeddingGemma 2 (better), LCO Embedding Omni 7B (open weights).