L

LanguageBind Omni

Oct 2023
LLanguageBind Omni
Compare in
on
price not verifiedprice
37.4MIEB lite
Oct 2023released
0K tokensMax input

Ranking?

Full ranking →
1Clap Htsat Fused81.12Clap Htsat Unfused80.83Larger Clap General80.64Larger Clap Music And Speech80.65Msclap 202379.76Fusion Embedding 2 2B Preview787LanguageBind Omni788LCO Embedding Omni 7B75.7

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Audio Zero-shot Classification · English16.8#14
MAEB v1 · Audio Pair Classification · English52.6#22
MAEB v1 · Audio Reranking · No linguistic content79.2#10
MAEB v1 · Audio Multilabel Classification · English78#7
MAEB v1 · Audio Clustering · multilingual (6 languages)2.9#23
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)2.9#23
MAEB v1 audio-only · Audio Pair Classification · English52.6#22
MAEB v1 audio-only · Audio Reranking · No linguistic content79.2#10
MIEB English · Visual semantic similarity (English) · multilingual (13 languages)69.6#11
MIEB English · Vision Centric QA · English53#8
MIEB Img · Visual semantic similarity (English) · English68.7#11
MIEB lite · Vision Centric QA · English55.6#10
MIEB lite · Any-to-any Multilingual Retrieval · multilingual (40 languages)22.6#29
MIEB lite · Visual semantic similarity (English) · English71.9#16
MIEB lite · Visual semantic similarity (multilingual) · multilingual (13 languages)37.4#26
MIEB multilingual · Vision Centric QA · English53#8
MIEB multilingual · Visual semantic similarity (English) · multilingual (13 languages)69.6#11
MIEB multilingual · Visual semantic similarity (multilingual) · multilingual (13 languages)37.4#26
MVEB v1 · Any-to-any Retrieval · English40.3#12
MVEB v1 · Video Zero-shot Classification · English47#9
MVEB v1 · Video Centric QA · English28.4#22

FAQ

How much does LanguageBind Omni cost?›

There is no per-unit API price: price not verified.

How good is LanguageBind Omni, and what is it best at?›

#26 of 56 in Multimodal.

Is LanguageBind Omni better than Fusion Embedding 2 2B Preview?›

On MAEB v1 · Audio Multilabel Classification · English, LanguageBind Omni scores 78 vs 78 — about the same.

When was LanguageBind Omni released? Is there a newer version?›

Released 2023-10-03. It is the current version in its line.

Is LanguageBind Omni open source?›

Yes, the weights are open (MIT licence).

Can I run LanguageBind Omni locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is LanguageBind Omni?›

LanguageBind Omni is an open-weights embeddings & retrieval model from LanguageBind, released Oct 2023.

What are the best alternatives to LanguageBind Omni?›

Clap Htsat Fused (better).