Data2vec Audio Base 960h

Feb 2022
Data2vec Audio Base 960h
Compare in
on
self-host onlyprice
32.3MAEB v1 audio-only
Feb 2022released
768Dimensions
enLanguages

Ranking?

Full ranking →
1EmbeddingGemma 267.52LCO Embedding Omni 7B67.33BidirLM Omni 2.5B Embedding66.74LCO Embedding Omni 3B66.75Jina Embeddings v5 Omni Nano65.6
···
34Encodec 24khz51.335Data2vec Audio Base 960h51.236Ast Finetuned Audioset 10 10 0.459351.2

Strong at

C
Embeddings & Retrieval#10 of 13

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Audio Classification · multilingual (102 languages)32.9#32
MAEB v1 · Audio Pair Classification · English51.2#35
MAEB v1 · Audio Reranking · No linguistic content49#39
MAEB v1 · Audio Multilabel Classification · English21.1#30
MAEB v1 · Audio Clustering · multilingual (6 languages)1.2#35
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)32.3#33
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)36.1#35
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)32.9#32
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)46.5#36
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)1.2#35
MAEB v1 audio-only · Audio Pair Classification · English51.2#35
MAEB v1 audio-only · Audio Reranking · No linguistic content49#39

FAQ

How much does Data2vec Audio Base 960h cost?›

There is no per-unit API price: self-host only.

Is Data2vec Audio Base 960h free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Data2vec Audio Base 960h, and what is it best at?›

#10 of 13 in Audio.

Is Data2vec Audio Base 960h better than Encodec 24khz?›

On MAEB v1 · Audio Pair Classification · English, Data2vec Audio Base 960h scores 51.2 vs 51.3 — about the same.

When was Data2vec Audio Base 960h released? Is there a newer version?›

Released 2022-02-07. It is the current version in its line.

Is Data2vec Audio Base 960h open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Data2vec Audio Base 960h locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Data2vec Audio Base 960h?›

Data2vec Audio Base 960h is an open-weights embeddings & retrieval model from Meta, released Feb 2022.

What are the best alternatives to Data2vec Audio Base 960h?›

Yamnet (better).