Cohere Embed Multilingual v3.0

Nov 2023
Cohere Embed Multilingual v3.0
Compare in
on
price not verifiedprice
55.7MTEB English v2
Nov 2023released
en, es, fr +101Languages

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B68.92Gte Qwen2 7B Instruct68.53F2LLM v2 8B68.14F2LLM v2 4B67.85Gte Qwen1.5 7B Instruct66
···
23KaLM Embedding Multilingual Mini Instruct v158.824Cohere Embed Multilingual v3.058.725KaLM Embedding Multilingual Mini v158.7

Strong at

B
Embeddings & Retrieval#54 of 200

Alternatives?

ModelScoreCostPriceWhat changes
cBetterF2LLM v2 14BunstatedOpen+17%——Languages: loses af, am, as +88BetterGte Qwen2 7B InstructunstatedOpen+17%——Languages: not verifiedcBetterF2LLM v2 8BunstatedOpen+16%——Languages: loses af, am, as +88cBetterF2LLM v2 4BunstatedOpen+15%——Languages: loses af, am, as +88BetterGte Qwen1.5 7B InstructunstatedOpen+12%——Languages: not verified

Benchmarks

in Embeddings & Retrieval
MTEB Persian v2 · Reranking · Persian74.8#1
JMTEB v2 · Clustering · Japanese51.2#25
JMTEB v2 · STS · Japanese79.3#49
LongEmbed · Mean over tasks · English39.3#79
LongEmbed · Mean over task types · English39.3#79
LongEmbed · Retrieval · English39.3#79
MTEB German v1 · Clustering · German37#16
MTEB German v1 · Classification · German69.8#24
MTEB German v1 · STS · German72.2#13
MTEB German v1 · Pair Classification · German55.2#19
MTEB German v1 · Reranking · German55.6#1
MTEB Europe v1 · Retrieval · multilingual (25 languages)56.2#23
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)85.8#51
MTEB Europe v1 · Classification · multilingual (23 languages)63.2#13
MTEB Europe v1 · Clustering · multilingual (29 languages)43.8#45
MTEB Europe v1 · Instruction Reranking · English-1.9#123
MTEB Europe v1 · Pair Classification · multilingual (11 languages)89.8#14
MTEB Europe v1 · Reranking · multilingual (12 languages)58#50
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)17.7#42
MTEB French v1 · Mean over tasks · multilingual (2 languages)62.8#14
MTEB French v1 · Mean over task types · multilingual (2 languages)62.3#14
MTEB French v1 · STS · French81.6#11
MTEB French v1 · Retrieval · multilingual (2 languages)60.1#16
MTEB French v1 · Reranking · French83.3#13
MTEB French v1 · Clustering · French49.6#15
MTEB French v1 · Classification · French70#20
MTEB French v1 · Summarization · French31.2#26
MTEB French v1 · Pair Classification · French60.3#69
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)68.7#10
MTEB Indic v1 · Mean over task types · multilingual (25 languages)67.1#12
MTEB Indic v1 · Classification · multilingual (8 languages)67.6#9
MTEB Indic v1 · Retrieval · multilingual (14 languages)83.3#12
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)77.1#9
MTEB Indic v1 · Reranking · multilingual (2 languages)87.3#19
MTEB Indic v1 · Pair Classification · Hindi74.8#37
MTEB Indic v1 · STS · multilingual (13 languages)46.7#37
MTEB Indic v1 · Clustering · multilingual (21 languages)33.1#58
MTEB Korean v2 · Reranking · Korean55.9#27
MTEB Korean v2 · Classification · Korean63.6#12
MTEB Dutch v1 · Reranking · Dutch90.1#34
MTEB Polish v1 · Pair Classification · Polish86.4#11
MTEB Polish v1 · Classification · Polish67.6#15
MTEB Polish v1 · STS · Polish69.4#13
MTEB Portuguese v1 · Multilabel Classification · Portuguese21.3#49
MTEB Law v1 · Mean over tasks · multilingual (3 languages)52.1#46
MTEB Law v1 · Mean over task types · multilingual (3 languages)52.1#46
MTEB Law v1 · Retrieval · multilingual (3 languages)52.1#46
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)60.8#21
MTEB Medical v1 · Mean over task types · multilingual (10 languages)58.7#24
MTEB Medical v1 · Retrieval · multilingual (10 languages)64.4#18
MTEB Medical v1 · Clustering · English37.6#66
MTEB Medical v1 · Reranking · Mandarin Chinese74#71
FollowIR · Mean over tasks · English-1.9#123
FollowIR · Mean over task types · English-1.9#123
FollowIR · Instruction Reranking · English-1.9#123
MTEB Spanish v1 · Pair Classification · Spanish68#50
MTEB Spanish v1 · Clustering · Spanish47.3#25
MTEB Spanish v1 · Reranking · Spanish64.3#3
MTEB Thai v1 · Clustering · Thai50.6#40
MTEB Thai v1 · Pair Classification · Thai73.5#46
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)62.2#10
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)61.3#16
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)45.3#19
MTEB Scandinavian v1 · Classification · multilingual (6 languages)65.3#16
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)70.5#13
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)64.3#99
MTEB Russian v1.1 · Classification · Russian63.9#30
MTEB Russian v1.1 · STS · Russian72.8#31
MTEB Russian v1.1 · Reranking · Russian70.1#11
MTEB Russian v1.1 · Clustering · Russian56.6#33
MTEB Russian v1.1 · Pair Classification · Russian58.6#49
MTEB Russian v1.1 · Multilabel Classification · Russian38.2#34
RTEB Finnish beta · Mean over tasks · English54.2#57
RTEB French beta · Mean over tasks · multilingual (2 languages)53.5#26
RTEB German beta · Mean over tasks · German46.8#67
RTEB Health beta · Mean over tasks · multilingual (4 languages)56.8#41
RTEB Law beta · Mean over tasks · multilingual (4 languages)42.3#75
MTEB multilingual v2 · Classification · multilingual (119 languages)62.9#29
MTEB multilingual v2 · Clustering · multilingual (208 languages)47#46
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)79.9#40
MTEB multilingual v2 · Retrieval · multilingual (120 languages)59.2#46
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)70.5#30
MTEB multilingual v2 · Instruction Reranking · English-1.9#123
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)22.7#43
MTEB multilingual v2 · Reranking · multilingual (22 languages)64.1#31

FAQ

How much does Cohere Embed Multilingual v3.0 cost?›

There is no per-unit API price: price not verified.

How good is Cohere Embed Multilingual v3.0, and what is it best at?›

#54 of 200 in Embeddings.

Is Cohere Embed Multilingual v3.0 better than KaLM Embedding Multilingual Mini Instruct v1?›

On MTEB Medical v1 · Mean over task types · multilingual (10 languages), Cohere Embed Multilingual v3.0 scores 58.7 vs 58.8 — about the same.

When was Cohere Embed Multilingual v3.0 released? Is there a newer version?›

Released 2023-11-02. It is the current version in its line.

Is Cohere Embed Multilingual v3.0 open source?›

No, Cohere Embed Multilingual v3.0 is a closed model available through an API. The closest open-weights option here is F2LLM v2 14B.

What is Cohere Embed Multilingual v3.0?›

Cohere Embed Multilingual v3.0 is a closed embeddings & retrieval model from Cohere, released Nov 2023.

What are the best alternatives to Cohere Embed Multilingual v3.0?›

F2LLM v2 14B (better).