O

Arabic Labse Matryoshka

Jun 2024
OArabic Labse Matryoshka
Compare in
on
self-host onlyprice
24.2MTEB English v2
Jun 2024released
0K tokensMax input
arLanguages

Rankingconfiguration unstated?

Full ranking →
1Qwen 3 Embedding 8B50.52F2LLM v2 14B503F2LLM v2 8B49.84Jina Embeddings v5 Omni Small49.65Jina Embeddings v5 Text Small49.5
···
37Multilingual E5 Base37.338Arabic Labse Matryoshka3739Arabic All Nli Triplet Matryoshka36.5

Strong at

C
Embeddings & Retrieval#178 of 200

Alternatives?

ModelScoreCostPriceWhat changes
BetterQwen 3 Embedding 8BunstatedOpen+36%—$0.01Languages: not verified+1iBetterMultilingual E5 Large InstructunstatedOpen+32%—$0.01BetterQwen 3 Embedding 0.6BunstatedOpen+20%—$0.01Languages: not verified+1BetterQwen 3 Embedding 4BunstatedOpen+32%—$0.02Languages: not verified+1iBetterE5 Mistral 7B InstructunstatedOpen+32%—$0.022Memory (4-bit): 0.3 GB → 4.3 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English23.2#181
BEIR · Mean over task types · English23.2#181
BEIR · Retrieval · English23.2#181
MTEB Persian v2 · Reranking · Persian60.1#46
JMTEB v2 · Clustering · Japanese40.8#69
JMTEB v2 · STS · Japanese75.9#72
LongEmbed · Mean over tasks · English22.9#145
LongEmbed · Mean over task types · English22.9#145
LongEmbed · Retrieval · English22.9#145
MTEB German v1 · Mean over tasks · German47.2#37
MTEB German v1 · Mean over task types · German45.8#37
MTEB German v1 · Classification · German63.3#53
MTEB German v1 · Pair Classification · German51.3#70
MTEB German v1 · STS · German65.7#45
MTEB German v1 · Clustering · German25.9#75
MTEB German v1 · Retrieval · German37.2#64
MTEB German v1 · Reranking · German31.6#66
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)54.1#26
MTEB Europe v1 · Mean over task types · multilingual (29 languages)49.2#25
MTEB Europe v1 · Classification · multilingual (23 languages)56.4#44
MTEB Europe v1 · Instruction Reranking · English-1.8#116
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)16.6#50
MTEB Europe v1 · STS · multilingual (8 languages)73.2#35
MTEB Europe v1 · Pair Classification · multilingual (11 languages)90#20
MTEB Europe v1 · Clustering · multilingual (29 languages)34.8#116
MTEB Europe v1 · Retrieval · multilingual (25 languages)37.3#108
MTEB Europe v1 · Reranking · multilingual (12 languages)49.4#114
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)87.1#44
MTEB French v1 · Mean over tasks · multilingual (2 languages)52.5#32
MTEB French v1 · Mean over task types · multilingual (2 languages)53.6#33
MTEB French v1 · STS · French78.4#25
MTEB French v1 · Retrieval · multilingual (2 languages)37.1#76
MTEB French v1 · Classification · French63.1#49
MTEB French v1 · Clustering · French41.5#52
MTEB French v1 · Reranking · French66.3#89
MTEB French v1 · Pair Classification · French57#110
MTEB French v1 · Summarization · French31.9#8
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)63#28
MTEB Indic v1 · Mean over task types · multilingual (25 languages)63.4#23
MTEB Indic v1 · Classification · multilingual (8 languages)61.9#38
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)67.5#31
MTEB Indic v1 · STS · multilingual (13 languages)55.5#13
MTEB Indic v1 · Reranking · multilingual (2 languages)81.1#75
MTEB Indic v1 · Retrieval · multilingual (14 languages)68.2#51
MTEB Indic v1 · Pair Classification · Hindi80.7#15
MTEB Indic v1 · Clustering · multilingual (21 languages)29.2#74
MTEB Korean v2 · STS · Korean81.1#30
MTEB Korean v2 · Classification · Korean46.4#60
MTEB Korean v2 · Reranking · Korean34.9#58
MTEB Dutch v1 · Mean over tasks · Dutch46.9#60
MTEB Dutch v1 · Mean over task types · Dutch57.1#58
MTEB Dutch v1 · Retrieval · Dutch39.3#74
MTEB Dutch v1 · Classification · Dutch55.8#59
MTEB Dutch v1 · Multilabel Classification · Dutch33.7#58
MTEB Dutch v1 · STS · Dutch77.7#41
MTEB Dutch v1 · Clustering · Dutch29#56
MTEB Dutch v1 · Reranking · Dutch84.2#93
MTEB Dutch v1 · Pair Classification · Dutch79.8#24
MTEB Polish v1 · Mean over tasks · Polish62#25
MTEB Polish v1 · Mean over task types · Polish61.8#23
MTEB Polish v1 · Classification · Polish56.6#51
MTEB Polish v1 · Clustering · Polish37#38
MTEB Polish v1 · STS · Polish67.7#28
MTEB Polish v1 · Pair Classification · Polish85.9#21
MTEB Portuguese v1 · Multilabel Classification · Portuguese18.7#126
MTEB Law v1 · Mean over tasks · multilingual (3 languages)35.9#117
MTEB Law v1 · Mean over task types · multilingual (3 languages)35.9#117
MTEB Law v1 · Retrieval · multilingual (3 languages)35.9#117
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)31.7#101
MTEB Medical v1 · Mean over task types · multilingual (10 languages)34.4#62
MTEB Medical v1 · Retrieval · multilingual (10 languages)30.8#105
MTEB Medical v1 · Clustering · English30.7#193
MTEB Medical v1 · Reranking · Mandarin Chinese41.6#110
FollowIR · Mean over tasks · English-1.8#116
FollowIR · Mean over task types · English-1.8#116
FollowIR · Instruction Reranking · English-1.8#116
MTEB Spanish v1 · STS · multilingual (2 languages)74.8#36
MTEB Spanish v1 · Clustering · Spanish40.8#79
MTEB Spanish v1 · Pair Classification · Spanish69#42
MTEB Spanish v1 · Reranking · Spanish37.1#82
MTEB Spanish v1 · Classification · Spanish85.4#31
MTEB Thai v1 · Pair Classification · Thai79.4#20
MTEB Thai v1 · Clustering · Thai26.9#99
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)50.4#51
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)51.1#49
MTEB Scandinavian v1 · Classification · multilingual (6 languages)57.1#61
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)46.5#61
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)35.5#78
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)65.2#89
MTEB Russian v1.1 · Mean over tasks · Russian51.4#44
MTEB Russian v1.1 · Mean over task types · Russian50.2#44
MTEB Russian v1.1 · Classification · Russian55#70
MTEB Russian v1.1 · Clustering · Russian49.8#72
MTEB Russian v1.1 · Reranking · Russian46.8#65
MTEB Russian v1.1 · Multilabel Classification · Russian32.2#68
MTEB Russian v1.1 · STS · Russian69.1#55
MTEB Russian v1.1 · Retrieval · Russian36.7#46
MTEB Russian v1.1 · Pair Classification · Russian61.8#26
RTEB French beta · Mean over tasks · multilingual (2 languages)20.8#128
RTEB German beta · Mean over tasks · German20.2#132
RTEB Law beta · Mean over tasks · multilingual (4 languages)29.2#159
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)53.6#51
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)47.2#51
MTEB multilingual v2 · Clustering · multilingual (208 languages)39.6#106
MTEB multilingual v2 · STS · multilingual (35 languages)72.1#44
MTEB multilingual v2 · Classification · multilingual (119 languages)55.1#62
MTEB multilingual v2 · Retrieval · multilingual (120 languages)37#118
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)19.9#62
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)70.3#33
MTEB multilingual v2 · Instruction Reranking · English-1.8#116
MTEB multilingual v2 · Reranking · multilingual (22 languages)51.6#81
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)80.8#30

FAQ

How much does Arabic Labse Matryoshka cost?›

There is no per-unit API price: self-host only.

Is Arabic Labse Matryoshka free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Arabic Labse Matryoshka, and what is it best at?›

#178 of 200 in Embeddings.

Is Arabic Labse Matryoshka better than Multilingual E5 Base?›

On MTEB Polish v1 · Clustering · Polish, Arabic Labse Matryoshka scores 37 vs 37.3 — about the same.

When was Arabic Labse Matryoshka released? Is there a newer version?›

Released 2024-06-16. It is the current version in its line.

Is Arabic Labse Matryoshka open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Arabic Labse Matryoshka locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Arabic Labse Matryoshka?›

Arabic Labse Matryoshka is an open-weights embeddings & retrieval model from Omartificial-Intelligence-Space, released Jun 2024.

What are the best alternatives to Arabic Labse Matryoshka?›

Qwen 3 Embedding 8B (better).