L

LanguageBind Omni

Oct 2023
LLanguageBind Omni
Compare in
on
price not verifiedprice
37.4MIEB lite
Oct 2023released
0K tokensMax input

Ranking?

Full ranking →
1E5 Omni 7B66.12EmbeddingGemma 264.63DNA VL STEER 2B63.74LCO Embedding Omni 7B62.35OmniEmbed v0.159.5
···
28CLIP ViT L 14 DataComp.XL S13B B90K22.629LanguageBind Omni22.630CLIP ViT L 14 Laion2B S32B B82K21.4

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Audio Zero-shot Classification · English16.8#14
MAEB v1 · Audio Pair Classification · English52.6#22
MAEB v1 · Audio Reranking · No linguistic content79.2#10
MAEB v1 · Audio Multilabel Classification · English78#7
MAEB v1 · Audio Clustering · multilingual (6 languages)2.9#23
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)2.9#23
MAEB v1 audio-only · Audio Pair Classification · English52.6#22
MAEB v1 audio-only · Audio Reranking · No linguistic content79.2#10
MIEB English · Visual semantic similarity (English) · multilingual (13 languages)69.6#11
MIEB English · Vision Centric QA · English53#8
MIEB Img · Visual semantic similarity (English) · English68.7#11
MIEB lite · Vision Centric QA · English55.6#10
MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages)22.6#29
MIEB lite · Visual semantic similarity (English) · English71.9#16
MIEB lite · Visual semantic similarity (multilingual) · multilingual (13 languages)37.4#26
MIEB multilingual · Vision Centric QA · English53#8
MIEB multilingual · Visual semantic similarity (English) · multilingual (13 languages)69.6#11
MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages)37.4#26
MVEB v1 · Any-to-any Retrieval · English40.3#12
MVEB v1 · Video Zero-shot Classification · English47#9
MVEB v1 · Video Centric QA · English28.4#22

FAQ

How much does LanguageBind Omni cost?›

There is no per-unit API price: price not verified.

How good is LanguageBind Omni, and what is it best at?›

#26 of 56 in Multimodal.

Is LanguageBind Omni better than CLIP ViT L 14 DataComp.XL S13B B90K?›

On MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages), LanguageBind Omni scores 22.6 vs 22.6 — about the same.

When was LanguageBind Omni released? Is there a newer version?›

Released 2023-10-03. It is the current version in its line.

Is LanguageBind Omni open source?›

Yes, the weights are open (MIT licence).

Can I run LanguageBind Omni locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is LanguageBind Omni?›

LanguageBind Omni is an open-weights embeddings & retrieval model from LanguageBind, released Oct 2023.

What are the best alternatives to LanguageBind Omni?›

EmbeddingGemma 2 (better), E5 Omni 7B (open weights).