l

Clap Htsat Fused

May 2023
lClap Htsat Fused
Compare in
on
self-host onlyprice
61.3MAEB v1 audio-only
May 2023released
768Dimensions
enLanguages

Ranking?

Full ranking →
1Larger Clap Music And Speech96.92MuQ MuLan Large96.33Larger Clap General95.64Ast Finetuned Audioset 10 10 0.459394.65Ebind Full93.8
···
11Vggish8912Clap Htsat Fused87.713Msclap 202287.2

Alternatives?

ModelScoreCostPriceWhat changes
lBetterLarger Clap Music And SpeechOpen+11%——Languages: not verifiedOBetterMuQ MuLan LargeOpen+10%——Memory (4-bit): 0.1 GB → 0.4 GBlBetterLarger Clap GeneralOpen+9%——Languages: not verifiedeBetterEbind FullunstatedOpen+7%——Memory (4-bit): 0.1 GB → 1.1 GBlBetterClap Htsat UnfusedOpen+6%——Languages: not verified

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Mean over tasks · multilingual (159 languages)33.5#15
MAEB v1 · Mean over task types · multilingual (159 languages)41.3#13
MAEB v1 · Audio Classification · multilingual (102 languages)41.2#18
MAEB v1 · Audio Zero-shot Classification · English13.2#20
MAEB v1 · Any-to-any Retrieval · multilingual (150 languages)17.6#16
MAEB v1 · Audio Pair Classification · English52#29
MAEB v1 · Audio Reranking · No linguistic content61.3#26
MAEB v1 · Audio Multilabel Classification · English81.1#1
MAEB v1 · Audio Clustering · multilingual (6 languages)22.7#2
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)43.5#18
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)53#17
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)41.2#18
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)87.7#12
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)22.7#2
MAEB v1 audio-only · Audio Pair Classification · English52#29
MAEB v1 audio-only · Audio Reranking · No linguistic content61.3#26

FAQ

How much does Clap Htsat Fused cost?›

There is no per-unit API price: self-host only.

Is Clap Htsat Fused free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Clap Htsat Fused, and what is it best at?›

#22 of 27 in Multimodal.

Is Clap Htsat Fused better than Vggish?›

On MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages), Clap Htsat Fused scores 87.7 vs 89 — lower.

When was Clap Htsat Fused released? Is there a newer version?›

Released 2023-05-22. It is the current version in its line.

Is Clap Htsat Fused open source?›

Yes, the weights are open (MIT licence).

Can I run Clap Htsat Fused locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Clap Htsat Fused?›

Clap Htsat Fused is an open-weights embeddings & retrieval model from laion, released May 2023.

What are the best alternatives to Clap Htsat Fused?›

Larger Clap Music And Speech (better).