Skip to content

LanguageBind Omni

Oct 2023

LLanguageBind Omni

Compare in

on

price not verifiedprice

37.4MIEB lite

Oct 2023released

0K tokensMax input

Ranking?

Full ranking →

1LCO Embedding Omni 7B82.4 2LCO Embedding Omni 3B79.5 3E5 Omni 7B77.3 4EmbeddingGemma 276.8 5E5 Omni 3B73.5

···

25Siglip Base Patch16 38437.5 26LanguageBind Omni37.4 27CLIP ViT L 14 DataComp.XL S13B B90K35.8

Alternatives?

ModelScoreCostPriceWhat changes

BetterEmbeddingGemma 2unstatedOpen×2.1—$0.02 LOpenLCO Embedding Omni 7Bunstated×2.2——Memory (4-bit): 0.7 GB → 5.4 GB

BetterJina Embeddings v5 Omni NanounstatedOpen+44%—$0.02

BetterJina Embeddings v5 Omni SmallunstatedOpen+74%—$0.05Memory (4-bit): 0.7 GB → 1 GB VBetterVoyage Multimodal 3+88%—$0.12

Run it yourself

estimate

Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality

LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval

MAEB v1 · Audio Zero-shot Classification · English16.8#14

MAEB v1 · Audio Pair Classification · English52.6#22

MAEB v1 · Audio Reranking · No linguistic content79.2#10

MAEB v1 · Audio Multilabel Classification · English78#7

MAEB v1 · Audio Clustering · multilingual (6 languages)2.9#23

MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)2.9#23

MAEB v1 audio-only · Audio Pair Classification · English52.6#22

MAEB v1 audio-only · Audio Reranking · No linguistic content79.2#10

MIEB English · Visual semantic similarity (English) · multilingual (13 languages)69.6#11

MIEB English · Vision Centric QA · English53#8

MIEB Img · Visual semantic similarity (English) · English68.7#11

MIEB lite · Vision Centric QA · English55.6#10

MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages)22.6#29

MIEB lite · Visual semantic similarity (English) · English71.9#16

MIEB lite · Visual semantic similarity (multilingual) · multilingual (13 languages)37.4#26

MIEB multilingual · Vision Centric QA · English53#8

MIEB multilingual · Visual semantic similarity (English) · multilingual (13 languages)69.6#11

MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages)37.4#26

MVEB v1 · Any-to-any Retrieval · English40.3#12

MVEB v1 · Video Zero-shot Classification · English47#9

MVEB v1 · Video Centric QA · English28.4#22

FAQ

How much does LanguageBind Omni cost?›

There is no per-unit API price: price not verified.

How good is LanguageBind Omni, and what is it best at?›

#26 of 56 in Multimodal.

Is LanguageBind Omni better than Siglip Base Patch16 384?›

On MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages), LanguageBind Omni scores 37.4 vs 37.5 — about the same.

When was LanguageBind Omni released? Is there a newer version?›

Released 2023-10-03. It is the current version in its line.

Is LanguageBind Omni open source?›

Yes, the weights are open (MIT licence).

Can I run LanguageBind Omni locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is LanguageBind Omni?›

LanguageBind Omni is an open-weights embeddings & retrieval model from LanguageBind, released Oct 2023.

What are the best alternatives to LanguageBind Omni?›

EmbeddingGemma 2 (better), LCO Embedding Omni 7B (open weights).