l

Clap Htsat Fused

May 2023
lClap Htsat Fused
Compare in
on
self-host onlyprice
61.3MAEB v1 audio-only
May 2023released
768Dimensions
enLanguages

Ranking?

Full ranking →
1E5 Omni 7B86.72MuQ MuLan Large85.43E5 Omni 3B84.54Jina Embeddings v5 Omni Small84.45Jina Embeddings v5 Omni Nano83.2
···
25Msclap 202262.926Clap Htsat Fused61.327HeAR S1.159.8

Alternatives?

ModelScoreCostPriceWhat changes
BetterJina Embeddings v5 Omni NanounstatedOpen+36%—$0.02Languages: not verified+1HOpenE5 Omni 7Bunstated+41%——Languages: not verified+1BetterEmbeddingGemma 2unstatedOpen+8%—$0.02Languages: not verified+1BetterJina Embeddings v5 Omni SmallunstatedOpen+38%—$0.05Languages: not verified+1OBetterMuQ MuLan LargeOpen+39%——Memory (4-bit): 0.1 GB → 0.4 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Mean over tasks · multilingual (159 languages)33.5#15
MAEB v1 · Mean over task types · multilingual (159 languages)41.3#13
MAEB v1 · Audio Classification · multilingual (102 languages)41.2#18
MAEB v1 · Audio Zero-shot Classification · English13.2#20
MAEB v1 · Any-to-any Retrieval · multilingual (150 languages)17.6#16
MAEB v1 · Audio Pair Classification · English52#29
MAEB v1 · Audio Reranking · No linguistic content61.3#26
MAEB v1 · Audio Multilabel Classification · English81.1#1
MAEB v1 · Audio Clustering · multilingual (6 languages)22.7#2
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)43.5#18
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)53#17
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)41.2#18
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)87.7#12
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)22.7#2
MAEB v1 audio-only · Audio Pair Classification · English52#29
MAEB v1 audio-only · Audio Reranking · No linguistic content61.3#26

FAQ

How much does Clap Htsat Fused cost?›

There is no per-unit API price: self-host only.

Is Clap Htsat Fused free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Clap Htsat Fused, and what is it best at?›

#22 of 27 in Multimodal.

Is Clap Htsat Fused better than Msclap 2022?›

On MAEB v1 audio-only · Audio Reranking · No linguistic content, Clap Htsat Fused scores 61.3 vs 62.9 — lower.

When was Clap Htsat Fused released? Is there a newer version?›

Released 2023-05-22. It is the current version in its line.

Is Clap Htsat Fused open source?›

Yes, the weights are open (MIT licence).

Can I run Clap Htsat Fused locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Clap Htsat Fused?›

Clap Htsat Fused is an open-weights embeddings & retrieval model from laion, released May 2023.

What are the best alternatives to Clap Htsat Fused?›

Jina Embeddings v5 Omni Nano (better), E5 Omni 7B (open weights).