Data2vec Audio Base 960h

Feb 2022
Data2vec Audio Base 960h
Compare in
on
self-host onlyprice
32.3MAEB v1 audio-only
Feb 2022released
768Dimensions
enLanguages

Ranking?

Full ranking →
1Ebind Full262Clap Htsat Fused22.73Msclap 202219.94Msclap 202315.25Qwen 2 Audio 7B12.7
···
34LCO Embedding Omni 3B1.335Data2vec Audio Base 960h1.236M Ctc T Large1.1

Strong at

C
Embeddings & Retrieval#10 of 13

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Audio Classification · multilingual (102 languages)32.9#32
MAEB v1 · Audio Pair Classification · English51.2#35
MAEB v1 · Audio Reranking · No linguistic content49#39
MAEB v1 · Audio Multilabel Classification · English21.1#30
MAEB v1 · Audio Clustering · multilingual (6 languages)1.2#35
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)32.3#33
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)36.1#35
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)32.9#32
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)46.5#36
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)1.2#35
MAEB v1 audio-only · Audio Pair Classification · English51.2#35
MAEB v1 audio-only · Audio Reranking · No linguistic content49#39

FAQ

How much does Data2vec Audio Base 960h cost?›

There is no per-unit API price: self-host only.

Is Data2vec Audio Base 960h free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Data2vec Audio Base 960h, and what is it best at?›

#10 of 13 in Audio.

Is Data2vec Audio Base 960h better than LCO Embedding Omni 3B?›

On MAEB v1 · Audio Clustering · multilingual (6 languages), Data2vec Audio Base 960h scores 1.2 vs 1.3 — about the same.

When was Data2vec Audio Base 960h released? Is there a newer version?›

Released 2022-02-07. It is the current version in its line.

Is Data2vec Audio Base 960h open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Data2vec Audio Base 960h locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Data2vec Audio Base 960h?›

Data2vec Audio Base 960h is an open-weights embeddings & retrieval model from Meta, released Feb 2022.

What are the best alternatives to Data2vec Audio Base 960h?›

Vggish (better).