l

Clap Htsat Fused

May 2023
lClap Htsat Fused
Compare in
on
self-host onlyprice
61.3MAEB v1 audio-only
May 2023released
768Dimensions
enLanguages

Ranking?

Full ranking →
1EmbeddingGemma 267.52LCO Embedding Omni 7B67.33BidirLM Omni 2.5B Embedding66.74LCO Embedding Omni 3B66.75Jina Embeddings v5 Omni Nano65.6
···
28Larger Clap Music And Speech52.129Clap Htsat Fused5230Larger Clap General51.9

Alternatives?

ModelScoreCostPriceWhat changes
BetterEmbeddingGemma 2unstatedOpen+30%—$0.02Languages: not verified+1BetterJina Embeddings v5 Omni NanounstatedOpen+26%—$0.02Languages: not verified+1BetterJina Embeddings v5 Omni SmallunstatedOpen+26%—$0.05Languages: not verified+1LBetterLCO Embedding Omni 7BunstatedOpen+29%——Languages: not verified+1BBetterBidirLM Omni 2.5B EmbeddingunstatedOpen+28%——Memory (4-bit): 0.1 GB → 1.5 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Mean over tasks · multilingual (159 languages)33.5#15
MAEB v1 · Mean over task types · multilingual (159 languages)41.3#13
MAEB v1 · Audio Pair Classification · English52#29
MAEB v1 · Audio Clustering · multilingual (6 languages)22.7#2
MAEB v1 · Any-to-any Retrieval · multilingual (150 languages)17.6#16
MAEB v1 · Audio Zero-shot Classification · English13.2#20
MAEB v1 · Audio Classification · multilingual (102 languages)41.2#18
MAEB v1 · Audio Multilabel Classification · English81.1#1
MAEB v1 · Audio Reranking · No linguistic content61.3#26
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)43.5#18
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)53#17
MAEB v1 audio-only · Audio Pair Classification · English52#29
MAEB v1 audio-only · Audio Reranking · No linguistic content61.3#26
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)22.7#2
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)41.2#18
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)87.7#12

FAQ

How much does Clap Htsat Fused cost?›

There is no per-unit API price: self-host only.

Is Clap Htsat Fused free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Clap Htsat Fused, and what is it best at?›

#22 of 27 in Multimodal.

Is Clap Htsat Fused better than Larger Clap Music And Speech?›

On MAEB v1 audio-only · Audio Pair Classification · English, Clap Htsat Fused scores 52 vs 52.1 — about the same.

When was Clap Htsat Fused released? Is there a newer version?›

Released 2023-05-22. It is the current version in its line.

Is Clap Htsat Fused open source?›

Yes, the weights are open (MIT licence).

Can I run Clap Htsat Fused locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Clap Htsat Fused?›

Clap Htsat Fused is an open-weights embeddings & retrieval model from laion, released May 2023.

What are the best alternatives to Clap Htsat Fused?›

EmbeddingGemma 2 (better).