Msclap 2023

Sep 2023
Msclap 2023
Compare in
on
price not verifiedprice
75.4MAEB v1 audio-only
Sep 2023released

Ranking?

Full ranking →
1Larger Clap Music And Speech96.92MuQ MuLan Large96.33Larger Clap General95.64Ast Finetuned Audioset 10 10 0.459394.65Ebind Full93.86Clap Htsat Unfused937Msclap 202392.88E5 Omni 7B92

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

History

2 versions
889092Jan 23Apr 23Jul 23Release dateMAEB v1 audio-only · Any-to-any Retrieval20222023
889092Jan 23Apr 23Jul 23Release dateMAEB v1 audio-only · Any-to-any Retrieval20222023

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Mean over tasks · multilingual (159 languages)34#14
MAEB v1 · Mean over task types · multilingual (159 languages)42.5#11
MAEB v1 · Audio Classification · multilingual (102 languages)42.2#16
MAEB v1 · Audio Zero-shot Classification · English12.6#22
MAEB v1 · Any-to-any Retrieval · multilingual (150 languages)18.7#13
MAEB v1 · Audio Pair Classification · English53.6#18
MAEB v1 · Audio Reranking · No linguistic content75.4#14
MAEB v1 · Audio Multilabel Classification · English79.7#5
MAEB v1 · Audio Clustering · multilingual (6 languages)15.2#4
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)44.2#16
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)55.8#7
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)42.2#16
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)92.8#7
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)15.2#4
MAEB v1 audio-only · Audio Pair Classification · English53.6#18
MAEB v1 audio-only · Audio Reranking · No linguistic content75.4#14

FAQ

How much does Msclap 2023 cost?›

There is no per-unit API price: price not verified.

How good is Msclap 2023, and what is it best at?›

#11 of 27 in Multimodal.

Is Msclap 2023 better than Clap Htsat Unfused?›

On MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages), Msclap 2023 scores 92.8 vs 93 — about the same.

When was Msclap 2023 released? Is there a newer version?›

Released 2023-09-01. It is the current version in its line.

Is Msclap 2023 open source?›

Yes, the weights are open (MIT licence).

Can I run Msclap 2023 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Msclap 2023?›

Msclap 2023 is an open-weights embeddings & retrieval model from Microsoft, released Sep 2023.

What are the best alternatives to Msclap 2023?›

Larger Clap Music And Speech (better).