M

Ast Finetuned Audioset 10 10 0.4593

Jul 2021
MAst Finetuned Audioset 10 10 0.4593
Compare in
on
self-host onlyprice
44.7MAEB v1 audio-only
Jul 2021released
768Dimensions

Ranking?

Full ranking →
1BidirLM Omni 2.5B Embedding53.62LCO Embedding Omni 7B51.53Qwen 2 Audio 7B514Jina Embeddings v5 Omni Small50.25E5 Omni 7B50.2
···
12Larger Clap Music And Speech45.413Ast Finetuned Audioset 10 10 0.459344.714Ebind Full44.6

Strong at

S
Embeddings & Retrieval#1 of 13

Alternatives?

ModelScoreCostPriceWhat changes
OpenVggish-8%——mOpenHeAR S1.1-8%——OpenYamnet-12%——sOpenM Ctc T Large-20%——Memory (4-bit): 0.1 GB → 0.6 GBsOpenCnn14 Esc50-22%——

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceBSD-3-Clausefree for commercial use

Benchmarks

in Embeddings & Retrieval
MAEB v1 · Audio Classification · multilingual (102 languages)45.7#15
MAEB v1 · Audio Pair Classification · English51.2#36
MAEB v1 · Audio Reranking · No linguistic content77.6#13
MAEB v1 · Audio Multilabel Classification · English72.7#10
MAEB v1 · Audio Clustering · multilingual (6 languages)6.9#10
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)44.7#13
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)55.2#10
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)45.7#15
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)94.6#4
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)6.9#10
MAEB v1 audio-only · Audio Pair Classification · English51.2#36
MAEB v1 audio-only · Audio Reranking · No linguistic content77.6#13

FAQ

How much does Ast Finetuned Audioset 10 10 0.4593 cost?›

There is no per-unit API price: self-host only.

Is Ast Finetuned Audioset 10 10 0.4593 free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Ast Finetuned Audioset 10 10 0.4593, and what is it best at?›

#1 of 13 in Audio. Strongest at: Embeddings & Retrieval.

Is Ast Finetuned Audioset 10 10 0.4593 better than Larger Clap Music And Speech?›

On MAEB v1 audio-only · Mean over tasks · multilingual (102 languages), Ast Finetuned Audioset 10 10 0.4593 scores 44.7 vs 45.4 — about the same.

When was Ast Finetuned Audioset 10 10 0.4593 released? Is there a newer version?›

Released 2021-07-08. It is the current version in its line.

Is Ast Finetuned Audioset 10 10 0.4593 open source?›

Yes, the weights are open (bsd-3-clause licence).

Can I run Ast Finetuned Audioset 10 10 0.4593 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Ast Finetuned Audioset 10 10 0.4593?›

Ast Finetuned Audioset 10 10 0.4593 is an open-weights embeddings & retrieval model from Massachusetts Institute of Technology, released Jul 2021.

What are the best alternatives to Ast Finetuned Audioset 10 10 0.4593?›

Vggish (open weights).