Seamless M4t v2 Large

Nov 2023
Older versionReplace withNo current replacement found yet.
Seamless M4t v2 Large
Compare in
on
price not verifiedprice
—main score
Nov 2023released
1,024Dimensions
4K tokensMax input
en, Estonian, es +86Languages

Ranking?

Retired models are left out of the current rankings.

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITno commercial use

Benchmarks

all categories
Speech & Voice
Open ASR · Armenian RTFx91.6
Open ASR · Armenian FLEURS WER6.4
Open ASR · Armenian MCV WER11.6
Embeddings & Retrieval
MAEB v1 · Audio Classification · multilingual (102 languages)47.6
MAEB v1 · Audio Pair Classification · English51.3
MAEB v1 · Audio Reranking · No linguistic content50.2
MAEB v1 · Audio Multilabel Classification · English28.8
MAEB v1 · Audio Clustering · multilingual (6 languages)0.5
MAEB v1 audio-only · Mean over tasks · multilingual (102 languages)41.3
MAEB v1 audio-only · Mean over task types · multilingual (102 languages)41.1
MAEB v1 audio-only · Audio Classification · multilingual (102 languages)47.6
MAEB v1 audio-only · Any-to-any Retrieval · multilingual (4 languages)55.8
MAEB v1 audio-only · Audio Clustering · multilingual (6 languages)0.5
MAEB v1 audio-only · Audio Pair Classification · English51.3
MAEB v1 audio-only · Audio Reranking · No linguistic content50.2

FAQ

How much does Seamless M4t v2 Large cost?›

There is no per-unit API price: price not verified.

When was Seamless M4t v2 Large released? Is there a newer version?›

Released 2023-11-06. It is retired.

Is Seamless M4t v2 Large open source?›

Yes, the weights are open (MIT licence).

Can I run Seamless M4t v2 Large locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Seamless M4t v2 Large?›

Seamless M4t v2 Large is an open-weights embeddings & retrieval model from Meta, released Nov 2023.

What are the best alternatives to Seamless M4t v2 Large?›

Ast Finetuned Audioset 10 10 0.4593 (better).