l

Wav2clip

Mar 2022
lWav2clip
Compare in
on
price not verifiedprice
68.9MAEB v1 audio-only
Mar 2022released

Ranking?

Full ranking →
1EmbeddingGemma 267.52LCO Embedding Omni 7B67.33BidirLM Omni 2.5B Embedding66.74LCO Embedding Omni 3B66.75Jina Embeddings v5 Omni Nano65.6
···
18Msclap 202353.619Wav2clip53.620Qwen 2.5 Omni 7B52.8

Alternatives?

ModelScoreCostPriceWhat changes
BetterEmbeddingGemma 2unstatedOpen+26%—$0.02Memory (4-bit): 0.1 GB → 0.2 GBBetterJina Embeddings v5 Omni NanounstatedOpen+22%—$0.02Memory (4-bit): 0.1 GB → 0.6 GBBetterJina Embeddings v5 Omni SmallunstatedOpen+22%—$0.05Memory (4-bit): 0.1 GB → 1 GBLBetterLCO Embedding Omni 7BunstatedOpen+26%——Memory (4-bit): 0.1 GB → 5.4 GBBBetterBidirLM Omni 2.5B EmbeddingunstatedOpen+25%——Memory (4-bit): 0.1 GB → 1.5 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Mean over tasks · multilingual (159 languages)26.6#20
MAEB v1 · Mean over task types · multilingual (159 languages)31.1#20
MAEB v1 · Audio Classification · multilingual (102 languages)37.4#25
MAEB v1 · Audio Zero-shot Classification · English10.8#28
MAEB v1 · Any-to-any Retrieval · multilingual (150 languages)9.5#19
MAEB v1 · Audio Pair Classification · English53.6#19
MAEB v1 · Audio Reranking · No linguistic content68.9#19
MAEB v1 · Audio Multilabel Classification · English31.8#26
MAEB v1 · Audio Clustering · multilingual (6 languages)6#15
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)38.8#25
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)48.9#23
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)37.4#25
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)78.5#19
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)6#15
MAEB v1 audio-only · Audio Pair Classification · English53.6#19
MAEB v1 audio-only · Audio Reranking · No linguistic content68.9#19

FAQ

How much does Wav2clip cost?›

There is no per-unit API price: price not verified.

How good is Wav2clip, and what is it best at?›

#16 of 27 in Multimodal.

Is Wav2clip better than Msclap 2023?›

On MAEB v1 · Audio Pair Classification · English, Wav2clip scores 53.6 vs 53.6 — about the same.

When was Wav2clip released? Is there a newer version?›

Released 2022-03-15. It is the current version in its line.

Is Wav2clip open source?›

Yes, the weights are open (MIT licence).

Can I run Wav2clip locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Wav2clip?›

Wav2clip is an open-weights embeddings & retrieval model from lyrebird, released Mar 2022.

What are the best alternatives to Wav2clip?›

EmbeddingGemma 2 (better).