Jina Embeddings v3

Sep 2024
Jina Embeddings v3
Compare in
on
$0.05per 1M tokens
54.3MTEB English v2
Sep 2024released
1,024 (or 64, 128)Dimensions
8K tokensMax input
en, Esperanto, es +90Languages

Rankingconfiguration unstated?

Full ranking →
1Gte Qwen2 7B Instruct65.32German Semantic STS v263.23Gte Qwen1.5 7B Instruct624F2LLM v2 14B59.85F2LLM v2 8B59.1
···
27Text Embedding 3 Small54.628Jina Embeddings v354.529Speed Embedding 7B Instruct54.4

Strong at

B
Embeddings & Retrieval#67 of 200

Alternatives?

ModelScoreCostPriceWhat changes
CheaperJina Embeddings v5 Text NanounstatedOpen+3%-60%$0.02Languages: not verifiedBetterJina Embeddings v5 Text SmallunstatedOpen+8%same$0.05Languages: not verified+1OpenGte Qwen2 7B Instructunstated+20%——Languages: not verified+1iCheaperE5 Mistral 7B InstructunstatedOpensame-55%$0.022Languages: loses Esperanto, es, Estonian +89+1CheaperText Embedding 3 Smallunstatedsame-60%$0.02Languages: not verified

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceCC BY-NC 4.0no commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English53.2#65
BEIR · Mean over task types · English53.2#65
BEIR · Retrieval · English53.2#65
BEIR-NL · Mean over tasks · Dutch45.6#4
BEIR-NL · Mean over task types · Dutch45.6#4
BEIR-NL · Retrieval · Dutch45.6#4
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese68.5#53
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese60.7#55
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese50.2#45
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese67.2#47
MTEB Persian v2 · Mean over tasks · Persian65.3#11
MTEB Persian v2 · Mean over task types · Persian67.8#11
MTEB Persian v2 · STS · Persian82.8#1
MTEB Persian v2 · Clustering · Persian59.2#21
MTEB Persian v2 · Classification · Persian66.5#16
MTEB Persian v2 · Retrieval · Persian57.5#8
MTEB Persian v2 · Reranking · Persian61.3#45
MTEB Persian v2 · Bitext Mining · Persian65.5#12
MTEB Persian v2 · Pair Classification · Persian81.8#20
JMTEB v2 · Clustering · Japanese47.7#45
JMTEB v2 · STS · Japanese80#41
MTEB German v1 · Mean over tasks · German60#8
MTEB German v1 · Mean over task types · German56.3#9
MTEB German v1 · Clustering · German36.8#17
MTEB German v1 · Retrieval · German55.3#11
MTEB German v1 · Classification · German79.2#12
MTEB German v1 · STS · German74.7#5
MTEB German v1 · Pair Classification · German54.5#28
MTEB German v1 · Reranking · German37.5#54
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)60.7#13
MTEB Europe v1 · Mean over task types · multilingual (29 languages)52.6#15
MTEB Europe v1 · Retrieval · multilingual (25 languages)54#29
MTEB Europe v1 · STS · multilingual (8 languages)78.3#1
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)86.2#49
MTEB Europe v1 · Classification · multilingual (23 languages)63.2#12
MTEB Europe v1 · Clustering · multilingual (29 languages)43.4#46
MTEB Europe v1 · Instruction Reranking · English-1.3#99
MTEB Europe v1 · Pair Classification · multilingual (11 languages)88.8#26
MTEB Europe v1 · Reranking · multilingual (12 languages)53.6#78
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)7.1#146
MTEB French v1 · Retrieval · multilingual (2 languages)59.7#18
MTEB French v1 · Reranking · French73.1#48
MTEB French v1 · Summarization · French30.7#48
MTEB French v1 · Pair Classification · French58.6#85
MTEB Indic v1 · Retrieval · multilingual (14 languages)82#16
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)70.3#22
MTEB Indic v1 · Reranking · multilingual (2 languages)77.2#83
MTEB Indic v1 · Pair Classification · Hindi74.5#38
MTEB Indic v1 · STS · multilingual (13 languages)54.7#15
MTEB Indic v1 · Clustering · multilingual (21 languages)40.5#34
MTEB Korean v2 · STS · Korean85#9
MTEB Korean v2 · Reranking · Korean42.7#50
MTEB Korean v2 · Classification · Korean58.3#29
MTEB Dutch v1 · Mean over tasks · Dutch57#23
MTEB Dutch v1 · Mean over task types · Dutch62.3#26
MTEB Dutch v1 · Classification · Dutch62.6#27
MTEB Dutch v1 · Clustering · Dutch39.2#26
MTEB Dutch v1 · Retrieval · Dutch59.1#29
MTEB Dutch v1 · STS · Dutch85.3#9
MTEB Dutch v1 · Multilabel Classification · Dutch34.8#45
MTEB Dutch v1 · Pair Classification · Dutch76.8#39
MTEB Dutch v1 · Reranking · Dutch78.5#129
MTEB Polish v1 · Pair Classification · Polish83.7#30
MTEB Polish v1 · Classification · Polish69.7#12
MTEB Polish v1 · STS · Polish72.8#1
MTEB Portuguese v1 · Multilabel Classification · Portuguese19.7#92
MTEB Law v1 · Mean over tasks · multilingual (3 languages)56.9#25
MTEB Law v1 · Mean over task types · multilingual (3 languages)56.9#25
MTEB Law v1 · Retrieval · multilingual (3 languages)56.9#25
MTEB Medical v1 · Clustering · English37.7#65
MTEB Medical v1 · Reranking · Mandarin Chinese78.3#57
FollowIR · Mean over tasks · English-1.3#99
FollowIR · Mean over task types · English-1.3#99
FollowIR · Instruction Reranking · English-1.3#99
MTEB Spanish v1 · Pair Classification · Spanish64.9#64
MTEB Spanish v1 · Reranking · Spanish47.5#56
MTEB Thai v1 · Mean over tasks · multilingual (2 languages)58.1#21
MTEB Thai v1 · Mean over task types · multilingual (2 languages)57.6#19
MTEB Thai v1 · Clustering · Thai46.8#45
MTEB Thai v1 · Classification · Thai63.6#21
MTEB Thai v1 · Pair Classification · Thai74.1#44
MTEB Thai v1 · Retrieval · multilingual (2 languages)57.8#21
MTEB Thai v1 · Reranking · Thai45.6#24
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)40.7#47
MTEB Scandinavian v1 · Classification · multilingual (6 languages)63.2#23
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)64.9#92
MTEB Russian v1.1 · Mean over tasks · Russian63.6#19
MTEB Russian v1.1 · Mean over task types · Russian61.1#19
MTEB Russian v1.1 · Classification · Russian65.2#27
MTEB Russian v1.1 · STS · Russian76#6
MTEB Russian v1.1 · Reranking · Russian53.9#60
MTEB Russian v1.1 · Clustering · Russian60.9#22
MTEB Russian v1.1 · Pair Classification · Russian59.2#46
MTEB Russian v1.1 · Retrieval · Russian73#15
MTEB Russian v1.1 · Multilabel Classification · Russian39.2#31
RTEB French beta · Mean over tasks · multilingual (2 languages)44.4#58
RTEB German beta · Mean over tasks · German59.4#42
RTEB Law beta · Mean over tasks · multilingual (4 languages)46.5#59
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)58.4#39
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)50.7#40
MTEB multilingual v2 · Classification · multilingual (119 languages)58.8#46
MTEB multilingual v2 · Clustering · multilingual (208 languages)45.6#51
MTEB multilingual v2 · STS · multilingual (35 languages)77.1#12
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)79.3#46
MTEB multilingual v2 · Retrieval · multilingual (120 languages)55.8#62
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)65.3#54
MTEB multilingual v2 · Instruction Reranking · English-1.3#99
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)18.4#77
MTEB multilingual v2 · Reranking · multilingual (22 languages)57.1#76

FAQ

How much does Jina Embeddings v3 cost?›

$0.05 per 1M tokens.

Is Jina Embeddings v3 free to use?›

There is no free API; it costs $0.05 per 1M tokens. The weights are open, so you can run it yourself.

How good is Jina Embeddings v3, and what is it best at?›

#67 of 200 in Embeddings.

Is Jina Embeddings v3 better than Text Embedding 3 Small?›

On MTEB German v1 · Pair Classification · German, Jina Embeddings v3 scores 54.5 vs 54.6 — about the same. It is 150% more expensive.

When was Jina Embeddings v3 released? Is there a newer version?›

Released 2024-09-18. It is the current version in its line.

Is Jina Embeddings v3 open source?›

Yes, the weights are open (cc-by-nc-4.0 licence).

Can I run Jina Embeddings v3 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Jina Embeddings v3?›

Jina Embeddings v3 is an open-weights embeddings & retrieval model from Jina AI, released Sep 2024.

What are the best alternatives to Jina Embeddings v3?›

Jina Embeddings v5 Text Nano (cheaper), Jina Embeddings v5 Text Small (better), Gte Qwen2 7B Instruct (open weights).