Cohere Embed Multilingual v3.0

Nov 2023
Cohere Embed Multilingual v3.0
Compare in
on
price not verifiedprice
55.7MTEB English v2
Nov 2023released
en, es, fr +101Languages

Rankingconfiguration unstated?

Full ranking →
1STS Multilingual Mpnet Base v290.92Bge Multilingual Gemma289.83Mmlw Roberta Large89.24Gte Qwen2 7B Instruct88.55Mmlw Roberta Base88.2
···
15Gte Qwen1.5 7B Instruct86.416Cohere Embed Multilingual v3.086.417Paraphrase Multilingual Mpnet Base v286.2

Strong at

B
Embeddings & Retrieval#54 of 200

Alternatives?

ModelScoreCostPriceWhat changes
BetterBge Multilingual Gemma2unstatedOpen+4%—$0.11Languages: not verifiedGOpenSTS Multilingual Mpnet Base v2unstated+5%——Languages: not verifiedsBetterMmlw Roberta LargeunstatedOpen+3%——Languages: loses en, es, fr +101BetterGte Qwen2 7B InstructunstatedOpen+2%——Languages: not verifiedsOpenMmlw Roberta Baseunstated+2%——Languages: loses en, es, fr +101

Benchmarks

in Embeddings & Retrieval
MTEB Persian v2 · Reranking · Persian74.8#1
JMTEB v2 · Clustering · Japanese51.2#31
JMTEB v2 · STS · Japanese79.3#55
LongEmbed · Mean over tasks · English39.3#79
LongEmbed · Mean over task types · English39.3#79
LongEmbed · Retrieval · English39.3#79
MTEB German v1 · Classification · German69.8#27
MTEB German v1 · Pair Classification · German55.2#25
MTEB German v1 · STS · German72.2#18
MTEB German v1 · Clustering · German37#19
MTEB German v1 · Reranking · German55.6#1
MTEB Europe v1 · Classification · multilingual (23 languages)63.2#15
MTEB Europe v1 · Instruction Reranking · English-1.9#124
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)17.7#42
MTEB Europe v1 · Pair Classification · multilingual (11 languages)89.8#25
MTEB Europe v1 · Clustering · multilingual (29 languages)43.8#45
MTEB Europe v1 · Retrieval · multilingual (25 languages)56.2#34
MTEB Europe v1 · Reranking · multilingual (12 languages)58#50
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)85.8#51
MTEB French v1 · Mean over tasks · multilingual (2 languages)62.8#14
MTEB French v1 · Mean over task types · multilingual (2 languages)62.3#14
MTEB French v1 · STS · French81.6#15
MTEB French v1 · Retrieval · multilingual (2 languages)60.1#18
MTEB French v1 · Classification · French70#23
MTEB French v1 · Clustering · French49.6#15
MTEB French v1 · Reranking · French83.3#19
MTEB French v1 · Pair Classification · French60.3#69
MTEB French v1 · Summarization · French31.2#27
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)68.7#11
MTEB Indic v1 · Mean over task types · multilingual (25 languages)67.1#14
MTEB Indic v1 · Classification · multilingual (8 languages)67.6#12
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)77.1#11
MTEB Indic v1 · STS · multilingual (13 languages)46.7#37
MTEB Indic v1 · Reranking · multilingual (2 languages)87.3#19
MTEB Indic v1 · Retrieval · multilingual (14 languages)83.3#15
MTEB Indic v1 · Pair Classification · Hindi74.8#37
MTEB Indic v1 · Clustering · multilingual (21 languages)33.1#58
MTEB Korean v2 · Classification · Korean63.6#12
MTEB Korean v2 · Reranking · Korean55.9#29
MTEB Dutch v1 · Reranking · Dutch90.1#34
MTEB Polish v1 · Classification · Polish67.6#19
MTEB Polish v1 · STS · Polish69.4#16
MTEB Polish v1 · Pair Classification · Polish86.4#16
MTEB Portuguese v1 · Multilabel Classification · Portuguese21.3#49
MTEB Law v1 · Mean over tasks · multilingual (3 languages)52.1#50
MTEB Law v1 · Mean over task types · multilingual (3 languages)52.1#50
MTEB Law v1 · Retrieval · multilingual (3 languages)52.1#50
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)60.8#22
MTEB Medical v1 · Mean over task types · multilingual (10 languages)58.7#26
MTEB Medical v1 · Retrieval · multilingual (10 languages)64.4#19
MTEB Medical v1 · Clustering · English37.6#66
MTEB Medical v1 · Reranking · Mandarin Chinese74#76
FollowIR · Mean over tasks · English-1.9#124
FollowIR · Mean over task types · English-1.9#124
FollowIR · Instruction Reranking · English-1.9#124
MTEB Spanish v1 · Clustering · Spanish47.3#25
MTEB Spanish v1 · Pair Classification · Spanish68#50
MTEB Spanish v1 · Reranking · Spanish64.3#3
MTEB Thai v1 · Pair Classification · Thai73.5#46
MTEB Thai v1 · Clustering · Thai50.6#40
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)62.2#16
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)61.3#22
MTEB Scandinavian v1 · Classification · multilingual (6 languages)65.3#17
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)70.5#14
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)45.3#26
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)64.3#99
MTEB Russian v1.1 · Classification · Russian63.9#32
MTEB Russian v1.1 · Clustering · Russian56.6#38
MTEB Russian v1.1 · Reranking · Russian70.1#11
MTEB Russian v1.1 · Multilabel Classification · Russian38.2#39
MTEB Russian v1.1 · STS · Russian72.8#33
MTEB Russian v1.1 · Pair Classification · Russian58.6#49
RTEB Finnish beta · Mean over tasks · English54.2#62
RTEB French beta · Mean over tasks · multilingual (2 languages)53.5#28
RTEB German beta · Mean over tasks · German46.8#74
RTEB Health beta · Mean over tasks · multilingual (4 languages)56.8#42
RTEB Law beta · Mean over tasks · multilingual (4 languages)42.3#82
MTEB multilingual v2 · Clustering · multilingual (208 languages)47#46
MTEB multilingual v2 · Classification · multilingual (119 languages)62.9#29
MTEB multilingual v2 · Retrieval · multilingual (120 languages)59.2#47
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)22.7#43
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)70.5#30
MTEB multilingual v2 · Instruction Reranking · English-1.9#124
MTEB multilingual v2 · Reranking · multilingual (22 languages)64.1#31
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)79.9#40

FAQ

How much does Cohere Embed Multilingual v3.0 cost?›

There is no per-unit API price: price not verified.

How good is Cohere Embed Multilingual v3.0, and what is it best at?›

#54 of 200 in Embeddings.

Is Cohere Embed Multilingual v3.0 better than Gte Qwen1.5 7B Instruct?›

On MTEB Polish v1 · Pair Classification · Polish, Cohere Embed Multilingual v3.0 scores 86.4 vs 86.4 — about the same.

When was Cohere Embed Multilingual v3.0 released? Is there a newer version?›

Released 2023-11-02. It is the current version in its line.

Is Cohere Embed Multilingual v3.0 open source?›

No, Cohere Embed Multilingual v3.0 is a closed model available through an API. The closest open-weights option here is STS Multilingual Mpnet Base v2.

What is Cohere Embed Multilingual v3.0?›

Cohere Embed Multilingual v3.0 is a closed embeddings & retrieval model from Cohere, released Nov 2023.

What are the best alternatives to Cohere Embed Multilingual v3.0?›

Bge Multilingual Gemma2 (better), STS Multilingual Mpnet Base v2 (open weights).