Jina Embeddings v3

Sep 2024
Jina Embeddings v3
Compare in
on
$0.05per 1M tokens
54.3MTEB English v2
Sep 2024released
1,024 (or 64, 128)Dimensions
8K tokensMax input
en, Esperanto, es +90Languages

Rankingconfiguration unstated?

Full ranking →
1Inf Retriever v154.52Inf Retriever v1 1.5B50.13Multilingual E5 Large45.94Jina Embeddings v345.65Bge M344.7

Strong at

B
Embeddings & Retrieval#67 of 200

Alternatives?

ModelScoreCostPriceWhat changes
iCheaperMultilingual E5 LargeunstatedOpensame-80%$0.01Max input: 8K tokens → 1K tokensiBetterInf Retriever v1unstatedOpen+20%——Languages: loses Esperanto, es, Estonian +88+1CheaperBge M3unstatedOpensame-80%$0.01Languages: not verifiediCheaperMultilingual E5 Large InstructunstatedOpen-3%-80%$0.01Max input: 8K tokens → 1K tokensiBetterInf Retriever v1 1.5BunstatedOpen+10%——Languages: loses Esperanto, es, Estonian +88+1

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceCC BY-NC 4.0no commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English53.2#67
BEIR · Mean over task types · English53.2#67
BEIR · Retrieval · English53.2#67
BEIR-NL · Mean over tasks · Dutch45.6#4
BEIR-NL · Mean over task types · Dutch45.6#4
BEIR-NL · Retrieval · Dutch45.6#4
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese50.2#51
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese60.7#55
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese68.5#55
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese67.2#52
MTEB Persian v2 · Mean over tasks · Persian65.3#11
MTEB Persian v2 · Mean over task types · Persian67.8#11
MTEB Persian v2 · Reranking · Persian61.3#45
MTEB Persian v2 · Pair Classification · Persian81.8#24
MTEB Persian v2 · Clustering · Persian59.2#27
MTEB Persian v2 · Classification · Persian66.5#16
MTEB Persian v2 · Retrieval · Persian57.5#8
MTEB Persian v2 · STS · Persian82.8#2
MTEB Persian v2 · Bitext Mining · Persian65.5#12
JMTEB v2 · Clustering · Japanese47.7#51
JMTEB v2 · STS · Japanese80#47
MTEB German v1 · Mean over tasks · German60#9
MTEB German v1 · Mean over task types · German56.3#13
MTEB German v1 · Classification · German79.2#13
MTEB German v1 · Pair Classification · German54.5#34
MTEB German v1 · STS · German74.7#8
MTEB German v1 · Clustering · German36.8#20
MTEB German v1 · Retrieval · German55.3#12
MTEB German v1 · Reranking · German37.5#54
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)60.7#15
MTEB Europe v1 · Mean over task types · multilingual (29 languages)52.6#17
MTEB Europe v1 · Classification · multilingual (23 languages)63.2#14
MTEB Europe v1 · Instruction Reranking · English-1.3#99
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)7.1#146
MTEB Europe v1 · STS · multilingual (8 languages)78.3#6
MTEB Europe v1 · Pair Classification · multilingual (11 languages)88.8#38
MTEB Europe v1 · Clustering · multilingual (29 languages)43.4#46
MTEB Europe v1 · Retrieval · multilingual (25 languages)54#40
MTEB Europe v1 · Reranking · multilingual (12 languages)53.6#78
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)86.2#49
MTEB French v1 · Retrieval · multilingual (2 languages)59.7#20
MTEB French v1 · Reranking · French73.1#56
MTEB French v1 · Pair Classification · French58.6#85
MTEB French v1 · Summarization · French30.7#50
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)70.3#26
MTEB Indic v1 · STS · multilingual (13 languages)54.7#15
MTEB Indic v1 · Reranking · multilingual (2 languages)77.2#84
MTEB Indic v1 · Retrieval · multilingual (14 languages)82#19
MTEB Indic v1 · Pair Classification · Hindi74.5#38
MTEB Indic v1 · Clustering · multilingual (21 languages)40.5#34
MTEB Korean v2 · STS · Korean85#12
MTEB Korean v2 · Classification · Korean58.3#32
MTEB Korean v2 · Reranking · Korean42.7#52
MTEB Dutch v1 · Mean over tasks · Dutch57#23
MTEB Dutch v1 · Mean over task types · Dutch62.3#26
MTEB Dutch v1 · Retrieval · Dutch59.1#29
MTEB Dutch v1 · Classification · Dutch62.6#27
MTEB Dutch v1 · Multilabel Classification · Dutch34.8#45
MTEB Dutch v1 · STS · Dutch85.3#9
MTEB Dutch v1 · Clustering · Dutch39.2#27
MTEB Dutch v1 · Reranking · Dutch78.5#130
MTEB Dutch v1 · Pair Classification · Dutch76.8#40
MTEB Polish v1 · Classification · Polish69.7#16
MTEB Polish v1 · STS · Polish72.8#2
MTEB Polish v1 · Pair Classification · Polish83.7#36
MTEB Portuguese v1 · Multilabel Classification · Portuguese19.7#93
MTEB Law v1 · Mean over tasks · multilingual (3 languages)56.9#29
MTEB Law v1 · Mean over task types · multilingual (3 languages)56.9#29
MTEB Law v1 · Retrieval · multilingual (3 languages)56.9#29
MTEB Medical v1 · Clustering · English37.7#65
MTEB Medical v1 · Reranking · Mandarin Chinese78.3#62
FollowIR · Mean over tasks · English-1.3#99
FollowIR · Mean over task types · English-1.3#99
FollowIR · Instruction Reranking · English-1.3#99
MTEB Spanish v1 · Pair Classification · Spanish64.9#64
MTEB Spanish v1 · Reranking · Spanish47.5#56
MTEB Thai v1 · Mean over tasks · multilingual (2 languages)58.1#21
MTEB Thai v1 · Mean over task types · multilingual (2 languages)57.6#19
MTEB Thai v1 · Retrieval · multilingual (2 languages)57.8#21
MTEB Thai v1 · Classification · Thai63.6#22
MTEB Thai v1 · Pair Classification · Thai74.1#44
MTEB Thai v1 · Clustering · Thai46.8#45
MTEB Thai v1 · Reranking · Thai45.6#28
MTEB Scandinavian v1 · Classification · multilingual (6 languages)63.2#25
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)40.7#54
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)64.9#92
MTEB Russian v1.1 · Mean over tasks · Russian63.6#19
MTEB Russian v1.1 · Mean over task types · Russian61.1#19
MTEB Russian v1.1 · Classification · Russian65.2#29
MTEB Russian v1.1 · Clustering · Russian60.9#25
MTEB Russian v1.1 · Reranking · Russian53.9#60
MTEB Russian v1.1 · Multilabel Classification · Russian39.2#35
MTEB Russian v1.1 · STS · Russian76#6
MTEB Russian v1.1 · Retrieval · Russian73#15
MTEB Russian v1.1 · Pair Classification · Russian59.2#46
RTEB French beta · Mean over tasks · multilingual (2 languages)44.4#60
RTEB German beta · Mean over tasks · German59.4#47
RTEB Law beta · Mean over tasks · multilingual (4 languages)46.5#66
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)58.4#39
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)50.7#40
MTEB multilingual v2 · Clustering · multilingual (208 languages)45.6#51
MTEB multilingual v2 · STS · multilingual (35 languages)77.1#12
MTEB multilingual v2 · Classification · multilingual (119 languages)58.8#46
MTEB multilingual v2 · Retrieval · multilingual (120 languages)55.8#63
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)18.4#77
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)65.3#54
MTEB multilingual v2 · Instruction Reranking · English-1.3#99
MTEB multilingual v2 · Reranking · multilingual (22 languages)57.1#76
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)79.3#46

FAQ

How much does Jina Embeddings v3 cost?›

$0.05 per 1M tokens.

Is Jina Embeddings v3 free to use?›

There is no free API; it costs $0.05 per 1M tokens. The weights are open, so you can run it yourself.

How good is Jina Embeddings v3, and what is it best at?›

#67 of 200 in Embeddings.

Is Jina Embeddings v3 better than Multilingual E5 Large?›

On BEIR-NL · Retrieval · Dutch, Jina Embeddings v3 scores 45.6 vs 45.9 — about the same. It is 400% more expensive.

When was Jina Embeddings v3 released? Is there a newer version?›

Released 2024-09-18. It is the current version in its line.

Is Jina Embeddings v3 open source?›

Yes, the weights are open (cc-by-nc-4.0 licence).

Can I run Jina Embeddings v3 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Jina Embeddings v3?›

Jina Embeddings v3 is an open-weights embeddings & retrieval model from Jina AI, released Sep 2024.

What are the best alternatives to Jina Embeddings v3?›

Multilingual E5 Large (cheaper), Inf Retriever v1 (better).