Vggish

Jun 2019
Vggish
Compare in
on
price not verifiedprice
41.1MAEB v1 audio-only
Jun 2019released
128Dimensions

Ranking?

Full ranking →
1BidirLM Omni 2.5B Embedding53.62LCO Embedding Omni 7B51.53Qwen 2 Audio 7B514Jina Embeddings v5 Omni Small50.25E5 Omni 7B50.2
···
19Clap Htsat Unfused42.920Vggish41.121HeAR S1.141.1

Strong at

A
Embeddings & Retrieval#2 of 13

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Audio Classification · multilingual (102 languages)39.2#21
MAEB v1 · Audio Pair Classification · English52.8#21
MAEB v1 · Audio Reranking · No linguistic content78.7#12
MAEB v1 · Audio Multilabel Classification · English47#21
MAEB v1 · Audio Clustering · multilingual (6 languages)7.8#7
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)41.1#20
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)53.5#14
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)39.2#21
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)89#11
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)7.8#7
MAEB v1 audio-only · Audio Pair Classification · English52.8#21
MAEB v1 audio-only · Audio Reranking · No linguistic content78.7#12

FAQ

How much does Vggish cost?›

There is no per-unit API price: price not verified.

How good is Vggish, and what is it best at?›

#2 of 13 in Audio. Strongest at: Embeddings & Retrieval.

Is Vggish better than Clap Htsat Unfused?›

On MAEB v1 audio-only · Mean over tasks · multilingual (102 languages), Vggish scores 41.1 vs 42.9 — lower.

When was Vggish released? Is there a newer version?›

Released 2019-06-13. It is the current version in its line.

Is Vggish open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Vggish locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Vggish?›

Vggish is an open-weights embeddings & retrieval model from Google, released Jun 2019.

What are the best alternatives to Vggish?›

Ast Finetuned Audioset 10 10 0.4593 (better).