LanguageBind Omni

Name: LanguageBind Omni
Brand: LanguageBind

Oct 2023

LLanguageBind Omni

Compare in

price not verifiedprice

37.4MIEB lite

Oct 2023released

0K tokensMax input

Ranking?

Full ranking →

1Ebind Audio Vision62.3 1Ebind Full62.3 3Pe Av Large62 4Pe Av Base59.6 5E5 Omni 7B59.4

···

11BidirLM Omni 2.5B Embedding45.5 12LanguageBind Omni40.3 13Jina Embeddings v5 Omni Small38.5

Alternatives?

ModelScoreCostPriceWhat changes

eBetterEbind Audio VisionOpen+54%——eBetterEbind FullunstatedOpen+54%——Memory (4-bit): 0.7 GB → 1.1 GB

BetterPe Av LargeOpen+54%——Memory (4-bit): 0.7 GB → 1.3 GB

BetterPe Av BaseOpen+48%——HBetterE5 Omni 7BunstatedOpen+47%——Memory (4-bit): 0.7 GB → 5.4 GB

Run it yourself

estimate

Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality

LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval

MAEB v1 · Audio Pair Classification · English52.6#22

MAEB v1 · Audio Clustering · multilingual (6 languages)2.9#23

MAEB v1 · Audio Zero-shot Classification · English16.8#14

MAEB v1 · Audio Multilabel Classification · English78#7

MAEB v1 · Audio Reranking · No linguistic content79.2#10

MAEB v1 audio-only · Audio Pair Classification · English52.6#22

MAEB v1 audio-only · Audio Reranking · No linguistic content79.2#10

MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)2.9#23

MIEB English · Vision Centric QA · English53#8

MIEB English · Visual semantic similarity (English) · multilingual (13 languages)69.6#11

MIEB Img · Visual semantic similarity (English) · English68.7#11

MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages)22.6#29

MIEB lite · Visual semantic similarity (multilingual) · multilingual (13 languages)37.4#26

MIEB lite · Vision Centric QA · English55.6#10

MIEB lite · Visual semantic similarity (English) · English71.9#16

MIEB multilingual · Visual semantic similarity (English) · multilingual (13 languages)69.6#11

MIEB multilingual · Vision Centric QA · English53#8

MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages)37.4#26

MVEB v1 · Video Zero-shot Classification · English47#9

MVEB v1 · Any-to-any Retrieval · English40.3#12

MVEB v1 · Video Centric QA · English28.4#22

FAQ

How much does LanguageBind Omni cost?›

There is no per-unit API price: price not verified.

How good is LanguageBind Omni, and what is it best at?›

#26 of 56 in Multimodal.

Is LanguageBind Omni better than BidirLM Omni 2.5B Embedding?›

On MVEB v1 · Any-to-any Retrieval · English, LanguageBind Omni scores 40.3 vs 45.5 — lower.

When was LanguageBind Omni released? Is there a newer version?›

Released 2023-10-03. It is the current version in its line.

Is LanguageBind Omni open source?›

Yes, the weights are open (MIT licence).

Can I run LanguageBind Omni locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is LanguageBind Omni?›

LanguageBind Omni is an open-weights embeddings & retrieval model from LanguageBind, released Oct 2023.

What are the best alternatives to LanguageBind Omni?›

Ebind Audio Vision (better).