Jina Embeddings v3

Sep 2024
Jina Embeddings v3
Compare in
on
$0.05per 1M tokens
54.3MTEB English v2
Sep 2024released
1,024 (or 64, 128)Dimensions
8K tokensMax input
en, Esperanto, es +90Languages

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B73.92F2LLM v2 8B733F2LLM v2 4B72.14Hakim71.65F2LLM v2 1.7B70.4
···
10Bge M365.611Jina Embeddings v365.312Gte Qwen2 7B Instruct64.6

Strong at

B
Embeddings & Retrieval#67 of 200

Alternatives?

ModelScoreCostPriceWhat changes
CheaperEmbeddingGemma 300MunstatedOpen+4%-96%$0.002Max input: 8K tokens → 2K tokens+1cOpenF2LLM v2 8Bunstated+12%——Languages: loses Assamese, Western Frisian, Scottish Gaelic +12+1CheaperBge M3unstatedOpensame-80%$0.01Languages: not verifiediCheaperMultilingual E5 LargeunstatedOpensame-80%$0.01Max input: 8K tokens → 1K tokensiCheaperE5 Mistral 7B InstructunstatedOpen-7%-55%$0.022Languages: loses Esperanto, es, Estonian +89+1

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceCC BY-NC 4.0no commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English53.2#65
BEIR · Mean over task types · English53.2#65
BEIR · Retrieval · English53.2#65
BEIR-NL · Mean over tasks · Dutch45.6#4
BEIR-NL · Mean over task types · Dutch45.6#4
BEIR-NL · Retrieval · Dutch45.6#4
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese68.5#53
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese60.7#55
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese50.2#45
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese67.2#47
MTEB Persian v2 · Mean over tasks · Persian65.3#11
MTEB Persian v2 · Mean over task types · Persian67.8#11
MTEB Persian v2 · STS · Persian82.8#1
MTEB Persian v2 · Clustering · Persian59.2#21
MTEB Persian v2 · Classification · Persian66.5#16
MTEB Persian v2 · Retrieval · Persian57.5#8
MTEB Persian v2 · Reranking · Persian61.3#45
MTEB Persian v2 · Bitext Mining · Persian65.5#12
MTEB Persian v2 · Pair Classification · Persian81.8#20
JMTEB v2 · Clustering · Japanese47.7#45
JMTEB v2 · STS · Japanese80#41
MTEB German v1 · Mean over tasks · German60#8
MTEB German v1 · Mean over task types · German56.3#9
MTEB German v1 · Clustering · German36.8#17
MTEB German v1 · Retrieval · German55.3#11
MTEB German v1 · Classification · German79.2#12
MTEB German v1 · STS · German74.7#5
MTEB German v1 · Pair Classification · German54.5#28
MTEB German v1 · Reranking · German37.5#54
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)60.7#13
MTEB Europe v1 · Mean over task types · multilingual (29 languages)52.6#15
MTEB Europe v1 · Retrieval · multilingual (25 languages)54#29
MTEB Europe v1 · STS · multilingual (8 languages)78.3#1
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)86.2#49
MTEB Europe v1 · Classification · multilingual (23 languages)63.2#12
MTEB Europe v1 · Clustering · multilingual (29 languages)43.4#46
MTEB Europe v1 · Instruction Reranking · English-1.3#99
MTEB Europe v1 · Pair Classification · multilingual (11 languages)88.8#26
MTEB Europe v1 · Reranking · multilingual (12 languages)53.6#78
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)7.1#146
MTEB French v1 · Retrieval · multilingual (2 languages)59.7#18
MTEB French v1 · Reranking · French73.1#48
MTEB French v1 · Summarization · French30.7#48
MTEB French v1 · Pair Classification · French58.6#85
MTEB Indic v1 · Retrieval · multilingual (14 languages)82#16
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)70.3#22
MTEB Indic v1 · Reranking · multilingual (2 languages)77.2#83
MTEB Indic v1 · Pair Classification · Hindi74.5#38
MTEB Indic v1 · STS · multilingual (13 languages)54.7#15
MTEB Indic v1 · Clustering · multilingual (21 languages)40.5#34
MTEB Korean v2 · STS · Korean85#9
MTEB Korean v2 · Reranking · Korean42.7#50
MTEB Korean v2 · Classification · Korean58.3#29
MTEB Dutch v1 · Mean over tasks · Dutch57#23
MTEB Dutch v1 · Mean over task types · Dutch62.3#26
MTEB Dutch v1 · Classification · Dutch62.6#27
MTEB Dutch v1 · Clustering · Dutch39.2#26
MTEB Dutch v1 · Retrieval · Dutch59.1#29
MTEB Dutch v1 · STS · Dutch85.3#9
MTEB Dutch v1 · Multilabel Classification · Dutch34.8#45
MTEB Dutch v1 · Pair Classification · Dutch76.8#39
MTEB Dutch v1 · Reranking · Dutch78.5#129
MTEB Polish v1 · Pair Classification · Polish83.7#30
MTEB Polish v1 · Classification · Polish69.7#12
MTEB Polish v1 · STS · Polish72.8#1
MTEB Portuguese v1 · Multilabel Classification · Portuguese19.7#92
MTEB Law v1 · Mean over tasks · multilingual (3 languages)56.9#25
MTEB Law v1 · Mean over task types · multilingual (3 languages)56.9#25
MTEB Law v1 · Retrieval · multilingual (3 languages)56.9#25
MTEB Medical v1 · Clustering · English37.7#65
MTEB Medical v1 · Reranking · Mandarin Chinese78.3#57
FollowIR · Mean over tasks · English-1.3#99
FollowIR · Mean over task types · English-1.3#99
FollowIR · Instruction Reranking · English-1.3#99
MTEB Spanish v1 · Pair Classification · Spanish64.9#64
MTEB Spanish v1 · Reranking · Spanish47.5#56
MTEB Thai v1 · Mean over tasks · multilingual (2 languages)58.1#21
MTEB Thai v1 · Mean over task types · multilingual (2 languages)57.6#19
MTEB Thai v1 · Clustering · Thai46.8#45
MTEB Thai v1 · Classification · Thai63.6#21
MTEB Thai v1 · Pair Classification · Thai74.1#44
MTEB Thai v1 · Retrieval · multilingual (2 languages)57.8#21
MTEB Thai v1 · Reranking · Thai45.6#24
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)40.7#47
MTEB Scandinavian v1 · Classification · multilingual (6 languages)63.2#23
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)64.9#92
MTEB Russian v1.1 · Mean over tasks · Russian63.6#19
MTEB Russian v1.1 · Mean over task types · Russian61.1#19
MTEB Russian v1.1 · Classification · Russian65.2#27
MTEB Russian v1.1 · STS · Russian76#6
MTEB Russian v1.1 · Reranking · Russian53.9#60
MTEB Russian v1.1 · Clustering · Russian60.9#22
MTEB Russian v1.1 · Pair Classification · Russian59.2#46
MTEB Russian v1.1 · Retrieval · Russian73#15
MTEB Russian v1.1 · Multilabel Classification · Russian39.2#31
RTEB French beta · Mean over tasks · multilingual (2 languages)44.4#58
RTEB German beta · Mean over tasks · German59.4#42
RTEB Law beta · Mean over tasks · multilingual (4 languages)46.5#59
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)58.4#39
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)50.7#40
MTEB multilingual v2 · Classification · multilingual (119 languages)58.8#46
MTEB multilingual v2 · Clustering · multilingual (208 languages)45.6#51
MTEB multilingual v2 · STS · multilingual (35 languages)77.1#12
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)79.3#46
MTEB multilingual v2 · Retrieval · multilingual (120 languages)55.8#62
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)65.3#54
MTEB multilingual v2 · Instruction Reranking · English-1.3#99
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)18.4#77
MTEB multilingual v2 · Reranking · multilingual (22 languages)57.1#76

FAQ

How much does Jina Embeddings v3 cost?›

$0.05 per 1M tokens.

Is Jina Embeddings v3 free to use?›

There is no free API; it costs $0.05 per 1M tokens. The weights are open, so you can run it yourself.

How good is Jina Embeddings v3, and what is it best at?›

#67 of 200 in Embeddings.

Is Jina Embeddings v3 better than Bge M3?›

On MTEB Persian v2 · Mean over tasks · Persian, Jina Embeddings v3 scores 65.3 vs 65.6 — about the same. It is 400% more expensive.

When was Jina Embeddings v3 released? Is there a newer version?›

Released 2024-09-18. It is the current version in its line.

Is Jina Embeddings v3 open source?›

Yes, the weights are open (cc-by-nc-4.0 licence).

Can I run Jina Embeddings v3 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Jina Embeddings v3?›

Jina Embeddings v3 is an open-weights embeddings & retrieval model from Jina AI, released Sep 2024.

What are the best alternatives to Jina Embeddings v3?›

EmbeddingGemma 300M (cheaper), F2LLM v2 8B (open weights).