Cohere Embed Multilingual v3.0

Nov 2023
Cohere Embed Multilingual v3.0
Compare in
on
price not verifiedprice
55.7MTEB English v2
Nov 2023released
en, es, fr +101Languages

Rankingconfiguration unstated?

Full ranking →
1Gte Qwen2 7B Instruct65.32German Semantic STS v263.23Gte Qwen1.5 7B Instruct624F2LLM v2 14B59.85F2LLM v2 8B59.1
···
18F2LLM v2 0.6B55.419Cohere Embed Multilingual v3.055.220E5 Mistral 7B Instruct55.2

Strong at

B
Embeddings & Retrieval#54 of 200

Alternatives?

ModelScoreCostPriceWhat changes
BetterJina Embeddings v5 Text SmallunstatedOpen+6%—$0.05Languages: not verifiedOpenGte Qwen2 7B Instructunstated+18%——Languages: not verifiedBetterText Embedding 3 Largeunstated+5%—$0.13Languages: not verifiedaBetterGerman Semantic STS v2unstatedOpen+14%——Languages: loses en, es, fr +100BetterGte Qwen1.5 7B InstructunstatedOpen+12%——Languages: not verified

Benchmarks

in Embeddings & Retrieval
MTEB Persian v2 · Reranking · Persian74.8#1
JMTEB v2 · Clustering · Japanese51.2#25
JMTEB v2 · STS · Japanese79.3#49
LongEmbed · Mean over tasks · English39.3#79
LongEmbed · Mean over task types · English39.3#79
LongEmbed · Retrieval · English39.3#79
MTEB German v1 · Clustering · German37#16
MTEB German v1 · Classification · German69.8#24
MTEB German v1 · STS · German72.2#13
MTEB German v1 · Pair Classification · German55.2#19
MTEB German v1 · Reranking · German55.6#1
MTEB Europe v1 · Retrieval · multilingual (25 languages)56.2#23
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)85.8#51
MTEB Europe v1 · Classification · multilingual (23 languages)63.2#13
MTEB Europe v1 · Clustering · multilingual (29 languages)43.8#45
MTEB Europe v1 · Instruction Reranking · English-1.9#123
MTEB Europe v1 · Pair Classification · multilingual (11 languages)89.8#14
MTEB Europe v1 · Reranking · multilingual (12 languages)58#50
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)17.7#42
MTEB French v1 · Mean over tasks · multilingual (2 languages)62.8#14
MTEB French v1 · Mean over task types · multilingual (2 languages)62.3#14
MTEB French v1 · STS · French81.6#11
MTEB French v1 · Retrieval · multilingual (2 languages)60.1#16
MTEB French v1 · Reranking · French83.3#13
MTEB French v1 · Clustering · French49.6#15
MTEB French v1 · Classification · French70#20
MTEB French v1 · Summarization · French31.2#26
MTEB French v1 · Pair Classification · French60.3#69
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)68.7#10
MTEB Indic v1 · Mean over task types · multilingual (25 languages)67.1#12
MTEB Indic v1 · Classification · multilingual (8 languages)67.6#9
MTEB Indic v1 · Retrieval · multilingual (14 languages)83.3#12
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)77.1#9
MTEB Indic v1 · Reranking · multilingual (2 languages)87.3#19
MTEB Indic v1 · Pair Classification · Hindi74.8#37
MTEB Indic v1 · STS · multilingual (13 languages)46.7#37
MTEB Indic v1 · Clustering · multilingual (21 languages)33.1#58
MTEB Korean v2 · Reranking · Korean55.9#27
MTEB Korean v2 · Classification · Korean63.6#12
MTEB Dutch v1 · Reranking · Dutch90.1#34
MTEB Polish v1 · Pair Classification · Polish86.4#11
MTEB Polish v1 · Classification · Polish67.6#15
MTEB Polish v1 · STS · Polish69.4#13
MTEB Portuguese v1 · Multilabel Classification · Portuguese21.3#49
MTEB Law v1 · Mean over tasks · multilingual (3 languages)52.1#46
MTEB Law v1 · Mean over task types · multilingual (3 languages)52.1#46
MTEB Law v1 · Retrieval · multilingual (3 languages)52.1#46
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)60.8#21
MTEB Medical v1 · Mean over task types · multilingual (10 languages)58.7#24
MTEB Medical v1 · Retrieval · multilingual (10 languages)64.4#18
MTEB Medical v1 · Clustering · English37.6#66
MTEB Medical v1 · Reranking · Mandarin Chinese74#71
FollowIR · Mean over tasks · English-1.9#123
FollowIR · Mean over task types · English-1.9#123
FollowIR · Instruction Reranking · English-1.9#123
MTEB Spanish v1 · Pair Classification · Spanish68#50
MTEB Spanish v1 · Clustering · Spanish47.3#25
MTEB Spanish v1 · Reranking · Spanish64.3#3
MTEB Thai v1 · Clustering · Thai50.6#40
MTEB Thai v1 · Pair Classification · Thai73.5#46
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)62.2#10
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)61.3#16
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)45.3#19
MTEB Scandinavian v1 · Classification · multilingual (6 languages)65.3#16
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)70.5#13
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)64.3#99
MTEB Russian v1.1 · Classification · Russian63.9#30
MTEB Russian v1.1 · STS · Russian72.8#31
MTEB Russian v1.1 · Reranking · Russian70.1#11
MTEB Russian v1.1 · Clustering · Russian56.6#33
MTEB Russian v1.1 · Pair Classification · Russian58.6#49
MTEB Russian v1.1 · Multilabel Classification · Russian38.2#34
RTEB Finnish beta · Mean over tasks · English54.2#57
RTEB French beta · Mean over tasks · multilingual (2 languages)53.5#26
RTEB German beta · Mean over tasks · German46.8#67
RTEB Health beta · Mean over tasks · multilingual (4 languages)56.8#41
RTEB Law beta · Mean over tasks · multilingual (4 languages)42.3#75
MTEB multilingual v2 · Classification · multilingual (119 languages)62.9#29
MTEB multilingual v2 · Clustering · multilingual (208 languages)47#46
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)79.9#40
MTEB multilingual v2 · Retrieval · multilingual (120 languages)59.2#46
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)70.5#30
MTEB multilingual v2 · Instruction Reranking · English-1.9#123
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)22.7#43
MTEB multilingual v2 · Reranking · multilingual (22 languages)64.1#31

FAQ

How much does Cohere Embed Multilingual v3.0 cost?›

There is no per-unit API price: price not verified.

How good is Cohere Embed Multilingual v3.0, and what is it best at?›

#54 of 200 in Embeddings.

Is Cohere Embed Multilingual v3.0 better than F2LLM v2 0.6B?›

On MTEB German v1 · Pair Classification · German, Cohere Embed Multilingual v3.0 scores 55.2 vs 55.4 — about the same.

When was Cohere Embed Multilingual v3.0 released? Is there a newer version?›

Released 2023-11-02. It is the current version in its line.

Is Cohere Embed Multilingual v3.0 open source?›

No, Cohere Embed Multilingual v3.0 is a closed model available through an API. The closest open-weights option here is Gte Qwen2 7B Instruct.

What is Cohere Embed Multilingual v3.0?›

Cohere Embed Multilingual v3.0 is a closed embeddings & retrieval model from Cohere, released Nov 2023.

What are the best alternatives to Cohere Embed Multilingual v3.0?›

Jina Embeddings v5 Text Small (better), Gte Qwen2 7B Instruct (open weights).