Granite Embedding 107M Multilingual

Dec 2024
Granite Embedding 107M Multilingual
Compare in
on
price not verifiedprice
47.9MTEB English v2
Dec 2024released
384Dimensions
1K tokensMax input
en, es, fr +9Languages

Rankingconfiguration unstated?

Full ranking →
1Ja Embed Sts85.62F2LLM v2 8B85.43F2LLM v2 14B85.14Harrier OSS v1 0.6B84.85F2LLM v2 4B84.7
···
58Arabic MiniLM L12 v2 All Nli Triplet77.159Granite Embedding 107M Multilingual7760Granite Embedding 278M Multilingual77

Strong at

C
Embeddings & Retrieval#116 of 200

Alternatives?

ModelScoreCostPriceWhat changes
BetterEmbeddingGemma 300MunstatedOpen+10%—$0.002Languages: not verified+1NOpenJa Embed Sts+11%——Languages: loses es, fr, de +7+1iBetterMultilingual E5 Large InstructunstatedOpen+8%—$0.01Memory (4-bit): 0.1 GB → 0.3 GBiBetterMultilingual E5 LargeunstatedOpen+5%—$0.01Memory (4-bit): 0.1 GB → 0.3 GBBetterBge M3unstatedOpen+3%—$0.01Languages: not verified+1

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English45.3#127
BEIR · Mean over task types · English45.3#127
BEIR · Retrieval · English45.3#127
MTEB Persian v2 · Reranking · Persian68.1#34
JMTEB v2 · Clustering · Japanese47.3#48
JMTEB v2 · STS · Japanese77#59
LongEmbed · Mean over tasks · English34.3#107
LongEmbed · Mean over task types · English34.3#107
LongEmbed · Retrieval · English34.3#107
MTEB German v1 · Mean over tasks · German50.2#27
MTEB German v1 · Mean over task types · German50.4#27
MTEB German v1 · Clustering · German30#45
MTEB German v1 · Retrieval · German42.8#36
MTEB German v1 · Classification · German62.7#54
MTEB German v1 · STS · German66.7#38
MTEB German v1 · Pair Classification · German52#57
MTEB German v1 · Reranking · German48#38
MTEB Europe v1 · Retrieval · multilingual (25 languages)46.4#46
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)76.9#87
MTEB Europe v1 · Classification · multilingual (23 languages)51#72
MTEB Europe v1 · Clustering · multilingual (29 languages)35.6#106
MTEB Europe v1 · Instruction Reranking · English-3#161
MTEB Europe v1 · Pair Classification · multilingual (11 languages)84.7#59
MTEB Europe v1 · Reranking · multilingual (12 languages)54.8#74
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)12.9#91
MTEB French v1 · Mean over tasks · multilingual (2 languages)55#24
MTEB French v1 · Mean over task types · multilingual (2 languages)56.5#23
MTEB French v1 · STS · French76.6#30
MTEB French v1 · Retrieval · multilingual (2 languages)48.4#38
MTEB French v1 · Reranking · French78.5#31
MTEB French v1 · Clustering · French40.4#65
MTEB French v1 · Classification · French62.5#49
MTEB French v1 · Summarization · French31.3#23
MTEB French v1 · Pair Classification · French58#93
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)56.8#42
MTEB Indic v1 · Mean over task types · multilingual (25 languages)51.6#41
MTEB Indic v1 · Classification · multilingual (8 languages)61.1#36
MTEB Indic v1 · Retrieval · multilingual (14 languages)66.9#46
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)35.5#52
MTEB Indic v1 · Reranking · multilingual (2 languages)81.3#72
MTEB Indic v1 · Pair Classification · Hindi61.5#91
MTEB Indic v1 · STS · multilingual (13 languages)26.9#73
MTEB Indic v1 · Clustering · multilingual (21 languages)27.8#76
MTEB Korean v2 · Reranking · Korean54.4#35
MTEB Korean v2 · Classification · Korean47.3#52
MTEB Dutch v1 · Mean over tasks · Dutch49.1#57
MTEB Dutch v1 · Mean over task types · Dutch56.3#61
MTEB Dutch v1 · Classification · Dutch54.7#65
MTEB Dutch v1 · Clustering · Dutch30#53
MTEB Dutch v1 · Retrieval · Dutch50.2#58
MTEB Dutch v1 · STS · Dutch70.3#65
MTEB Dutch v1 · Multilabel Classification · Dutch33.9#57
MTEB Dutch v1 · Pair Classification · Dutch70.1#60
MTEB Dutch v1 · Reranking · Dutch84.7#89
MTEB Polish v1 · Pair Classification · Polish75.6#67
MTEB Polish v1 · Classification · Polish45.5#66
MTEB Polish v1 · STS · Polish60.2#51
MTEB Portuguese v1 · Multilabel Classification · Portuguese18.7#122
MTEB Law v1 · Mean over tasks · multilingual (3 languages)41.8#69
MTEB Law v1 · Mean over task types · multilingual (3 languages)41.8#69
MTEB Law v1 · Retrieval · multilingual (3 languages)41.8#69
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)46.8#44
MTEB Medical v1 · Mean over task types · multilingual (10 languages)45.9#45
MTEB Medical v1 · Retrieval · multilingual (10 languages)48.8#46
MTEB Medical v1 · Clustering · English33.7#150
MTEB Medical v1 · Reranking · Mandarin Chinese55.3#91
FollowIR · Mean over tasks · English-3#161
FollowIR · Mean over task types · English-3#161
FollowIR · Instruction Reranking · English-3#161
MTEB Spanish v1 · Pair Classification · Spanish61.5#89
MTEB Spanish v1 · Clustering · Spanish42.7#59
MTEB Spanish v1 · Reranking · Spanish59#37
MTEB Thai v1 · Clustering · Thai43.2#57
MTEB Thai v1 · Pair Classification · Thai63.3#88
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)35.5#72
MTEB Scandinavian v1 · Classification · multilingual (6 languages)49.8#78
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)65#91
CoIR · Mean over tasks · multilingual (9 languages)36.7#57
CoIR · Mean over task types · multilingual (9 languages)36.7#57
CoIR · Retrieval · multilingual (9 languages)36.7#57
MTEB Code v1 · Mean over tasks · multilingual (15 languages)40.7#49
MTEB Code v1 · Mean over task types · multilingual (15 languages)40.7#49
MTEB Code v1 · Retrieval · multilingual (15 languages)40.7#49
MTEB Russian v1.1 · Mean over tasks · Russian51.6#43
MTEB Russian v1.1 · Mean over task types · Russian51.7#43
MTEB Russian v1.1 · Classification · Russian50.3#85
MTEB Russian v1.1 · STS · Russian62.8#66
MTEB Russian v1.1 · Reranking · Russian60.4#50
MTEB Russian v1.1 · Clustering · Russian47.5#75
MTEB Russian v1.1 · Pair Classification · Russian55.5#87
MTEB Russian v1.1 · Retrieval · Russian55.8#38
MTEB Russian v1.1 · Multilabel Classification · Russian29.2#82
RTEB French beta · Mean over tasks · multilingual (2 languages)37.4#76
RTEB German beta · Mean over tasks · German32.8#96
RTEB Law beta · Mean over tasks · multilingual (4 languages)32.7#121
MTEB multilingual v2 · Classification · multilingual (119 languages)52.6#73
MTEB multilingual v2 · Clustering · multilingual (208 languages)40.4#91
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)75.3#81
MTEB multilingual v2 · Retrieval · multilingual (120 languages)48.1#81
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)54.1#78
MTEB multilingual v2 · Instruction Reranking · English-3#161
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)17.3#89
MTEB multilingual v2 · Reranking · multilingual (22 languages)58.5#74

FAQ

How much does Granite Embedding 107M Multilingual cost?›

There is no per-unit API price: price not verified.

How good is Granite Embedding 107M Multilingual, and what is it best at?›

#116 of 200 in Embeddings.

Is Granite Embedding 107M Multilingual better than Arabic MiniLM L12 v2 All Nli Triplet?›

On JMTEB v2 · STS · Japanese, Granite Embedding 107M Multilingual scores 77 vs 77.1 — about the same.

When was Granite Embedding 107M Multilingual released? Is there a newer version?›

Released 2024-12-18. It is the current version in its line.

Is Granite Embedding 107M Multilingual open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Granite Embedding 107M Multilingual locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Granite Embedding 107M Multilingual?›

Granite Embedding 107M Multilingual is an open-weights embeddings & retrieval model from IBM, released Dec 2024.

What are the best alternatives to Granite Embedding 107M Multilingual?›

EmbeddingGemma 300M (better), Ja Embed Sts (open weights).