Jina Clip v1

May 2024
Jina Clip v1
Compare in
on
$0.05per 1M tokens
14.8MIEB lite
May 2024released
8K tokensMax input
enLanguages

Ranking?

Full ranking →
1EVA02 CLIP B 16862Siglip So400m Patch14 38484.63Siglip Large Patch16 38483.74CLIP ViT BigG 14 Laion2B 39B B160k83.65CLIP ViT G 14 Laion2B S34B B88K82.8
···
34Blip Itm Large Flickr69.435Jina Clip v16936Blip Itm Base Coco67.2

Strong at

C
Embeddings & Retrieval#79 of 89

Alternatives?

ModelScoreCostPriceWhat changes
CheaperJina Embeddings v5 Omni NanounstatedOpen-3%-60%$0.02Languages: not verified+1BetterJina Embeddings v5 Omni SmallunstatedOpen+9%same$0.05Languages: not verified+1QOpenEVA02 CLIP B 16unstated+25%——Max input: 8K tokens → 0K tokens+2VBetterVoyage Multimodal 3+3%+140%$0.12Languages: not verifiedBetterSiglip So400m Patch14 384Open+23%——Max input: 8K tokens → 0K tokens+2

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
MIEB English · Mean over tasks · multilingual (13 languages)49.5#28
MIEB English · Mean over task types · multilingual (13 languages)49.5#28
MIEB English · Document Understanding · English17.6#71
MIEB English · Zero-shot Classification · English53.8#26
MIEB English · Any-to-any Retrieval · English32.3#23
MIEB English · Visual semantic similarity (English) · multilingual (13 languages)62.6#30
MIEB English · Image Classification · English69#35
MIEB English · Compositionality · English45.1#5
MIEB English · Vision Centric QA · English45.4#31
MIEB English · Image Clustering · English70#39
MIEB Img · Mean over tasks · multilingual (13 languages)54.1#27
MIEB Img · Mean over task types · multilingual (13 languages)54.1#27
MIEB Img · Image Classification · English69#35
MIEB Img · Any-to-any Retrieval · English31#30
MIEB Img · Visual semantic similarity (English) · English61.8#28
MIEB Img · Visual semantic similarity (multilingual) · multilingual (13 languages)38.8#25
MIEB Img · Image Clustering · English70#39
MIEB lite · Mean over tasks · multilingual (41 languages)41.6#35
MIEB lite · Mean over task types · multilingual (41 languages)41.6#35
MIEB lite · Vision Centric QA · English47.4#35
MIEB lite · Any-to-any Retrieval · English27.3#27
MIEB lite · Document Understanding · English14.8#79
MIEB lite · Zero-shot Classification · English52.6#28
MIEB lite · Compositionality · English39#11
MIEB lite · Image Classification · English64.4#43
MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages)16#38
MIEB lite · Image Clustering · English57.1#48
MIEB lite · Visual semantic similarity (English) · English63.2#36
MIEB lite · Visual semantic similarity (multilingual) · multilingual (13 languages)34.6#29
MIEB multilingual · Mean over tasks · multilingual (41 languages)44.9#27
MIEB multilingual · Mean over task types · multilingual (41 languages)44.9#27
MIEB multilingual · Zero-shot Classification · English53.8#26
MIEB multilingual · Image Classification · English69#35
MIEB multilingual · Document Understanding · English17.6#71
MIEB multilingual · Any-to-any Retrieval · English32.3#23
MIEB multilingual · Compositionality · English45.1#5
MIEB multilingual · Vision Centric QA · English45.4#31
MIEB multilingual · Visual semantic similarity (English) · multilingual (13 languages)62.6#30
MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages)34.6#29
MIEB multilingual · Any-to-any Multilingual Retrieval · multilingual (40 languages)18.1#29
MIEB multilingual · Image Clustering · English70#39
ViDoRe v1&v2 · Mean over tasks · multilingual (4 languages)15.4#49

FAQ

How much does Jina Clip v1 cost?›

$0.05 per 1M tokens.

Is Jina Clip v1 free to use?›

There is no free API; it costs $0.05 per 1M tokens. The weights are open, so you can run it yourself.

How good is Jina Clip v1, and what is it best at?›

#79 of 89 in Multimodal.

Is Jina Clip v1 better than Blip Itm Large Flickr?›

On MIEB English · Image Classification · English, Jina Clip v1 scores 69 vs 69.4 — about the same.

When was Jina Clip v1 released? Is there a newer version?›

Released 2024-05-30. It is the current version in its line.

Is Jina Clip v1 open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Jina Clip v1 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Jina Clip v1?›

Jina Clip v1 is an open-weights embeddings & retrieval model from Jina AI, released May 2024.

What are the best alternatives to Jina Clip v1?›

Jina Embeddings v5 Omni Nano (cheaper), Jina Embeddings v5 Omni Small (better), EVA02 CLIP B 16 (open weights).