Msclap 2023

Sep 2023
Msclap 2023
Compare in
on
price not verifiedprice
75.4MAEB v1 audio-only
Sep 2023released

Ranking?

Full ranking →
1BidirLM Omni 2.5B Embedding59.82Qwen 2 Audio 7B58.33LCO Embedding Omni 7B56.24LCO Embedding Omni 3B54.55EmbeddingGemma 252.3
···
15Ast Finetuned Audioset 10 10 0.459345.716Msclap 202342.217Clap Htsat Unfused41.9

Alternatives?

ModelScoreCostPriceWhat changes
BetterEmbeddingGemma 2unstatedOpen+24%—$0.02Memory (4-bit): 0.1 GB → 0.2 GBBOpenBidirLM Omni 2.5B Embeddingunstated+42%——Memory (4-bit): 0.1 GB → 1.5 GBBetterJina Embeddings v5 Omni NanounstatedOpen+22%—$0.02Memory (4-bit): 0.1 GB → 0.6 GBBetterJina Embeddings v5 Omni SmallunstatedOpen+23%—$0.05Memory (4-bit): 0.1 GB → 1 GBBetterQwen 2 Audio 7BOpen+38%——Memory (4-bit): 0.1 GB → 4.2 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

History

2 versions
36384042Jan 23Apr 23Jul 23Release dateMAEB · Audio Classification20222023
36384042Jan 23Apr 23Jul 23Release dateMAEB · Audio Classification20222023

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Mean over tasks · multilingual (159 languages)34#14
MAEB v1 · Mean over task types · multilingual (159 languages)42.5#11
MAEB v1 · Audio Classification · multilingual (102 languages)42.2#16
MAEB v1 · Audio Zero-shot Classification · English12.6#22
MAEB v1 · Any-to-any Retrieval · multilingual (150 languages)18.7#13
MAEB v1 · Audio Pair Classification · English53.6#18
MAEB v1 · Audio Reranking · No linguistic content75.4#14
MAEB v1 · Audio Multilabel Classification · English79.7#5
MAEB v1 · Audio Clustering · multilingual (6 languages)15.2#4
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)44.2#16
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)55.8#7
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)42.2#16
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)92.8#7
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)15.2#4
MAEB v1 audio-only · Audio Pair Classification · English53.6#18
MAEB v1 audio-only · Audio Reranking · No linguistic content75.4#14

FAQ

How much does Msclap 2023 cost?›

There is no per-unit API price: price not verified.

How good is Msclap 2023, and what is it best at?›

#11 of 27 in Multimodal.

Is Msclap 2023 better than Ast Finetuned Audioset 10 10 0.4593?›

On MAEB v1 · Audio Classification · multilingual (102 languages), Msclap 2023 scores 42.2 vs 45.7 — lower.

When was Msclap 2023 released? Is there a newer version?›

Released 2023-09-01. It is the current version in its line.

Is Msclap 2023 open source?›

Yes, the weights are open (MIT licence).

Can I run Msclap 2023 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Msclap 2023?›

Msclap 2023 is an open-weights embeddings & retrieval model from Microsoft, released Sep 2023.

What are the best alternatives to Msclap 2023?›

EmbeddingGemma 2 (better), BidirLM Omni 2.5B Embedding (open weights).