l

Wav2clip

Mar 2022
lWav2clip
Compare in
on
price not verifiedprice
68.9MAEB v1 audio-only
Mar 2022released

Ranking?

Full ranking →
1Larger Clap Music And Speech96.92MuQ MuLan Large96.33Larger Clap General95.64Ast Finetuned Audioset 10 10 0.459394.65Ebind Full93.8
···
18Yamnet79.819Wav2clip78.520Cnn14 Esc5077

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Mean over tasks · multilingual (159 languages)26.6#20
MAEB v1 · Mean over task types · multilingual (159 languages)31.1#20
MAEB v1 · Audio Classification · multilingual (102 languages)37.4#25
MAEB v1 · Audio Zero-shot Classification · English10.8#28
MAEB v1 · Any-to-any Retrieval · multilingual (150 languages)9.5#19
MAEB v1 · Audio Pair Classification · English53.6#19
MAEB v1 · Audio Reranking · No linguistic content68.9#19
MAEB v1 · Audio Multilabel Classification · English31.8#26
MAEB v1 · Audio Clustering · multilingual (6 languages)6#15
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)38.8#25
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)48.9#23
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)37.4#25
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)78.5#19
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)6#15
MAEB v1 audio-only · Audio Pair Classification · English53.6#19
MAEB v1 audio-only · Audio Reranking · No linguistic content68.9#19

FAQ

How much does Wav2clip cost?›

There is no per-unit API price: price not verified.

How good is Wav2clip, and what is it best at?›

#16 of 27 in Multimodal.

Is Wav2clip better than Yamnet?›

On MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages), Wav2clip scores 78.5 vs 79.8 — lower.

When was Wav2clip released? Is there a newer version?›

Released 2022-03-15. It is the current version in its line.

Is Wav2clip open source?›

Yes, the weights are open (MIT licence).

Can I run Wav2clip locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Wav2clip?›

Wav2clip is an open-weights embeddings & retrieval model from lyrebird, released Mar 2022.

What are the best alternatives to Wav2clip?›

Jina Embeddings v5 Omni Nano (better), Larger Clap Music And Speech (open weights).