Granite Embedding 278M Multilingual

Dec 2024
Granite Embedding 278M Multilingual
Compare in
on
price not verifiedprice
51.4MTEB English v2
Dec 2024released
768Dimensions
1K tokensMax input
en, es, fr +9Languages

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B86.12F2LLM v2 8B85.43F2LLM v2 4B85.34F2LLM v2 1.7B855F2LLM v2 0.6B84.1
···
40Bekko Embedding v1 A25m64.141Granite Embedding 278M Multilingual6442Stella En 400M v563.8

Strong at

B
Embeddings & Retrieval#96 of 200

Alternatives?

ModelScoreCostPriceWhat changes
iBetterMultilingual E5 Large InstructunstatedOpen+8%—$0.01Memory (4-bit): 0.2 GB → 0.3 GBcOpenF2LLM v2 8Bunstated+33%——Memory (4-bit): 0.2 GB → 4.5 GBiBetterE5 Mistral 7B InstructunstatedOpen+15%—$0.022Languages: loses es, fr, de +8+1VBetterVoyage Multilingual 2unstated+7%—$0.12Languages: not verifiedcBetterF2LLM v2 14BunstatedOpen+34%——Memory (4-bit): 0.2 GB → 8.4 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English48.2#117
BEIR · Mean over task types · English48.2#117
BEIR · Retrieval · English48.2#117
MTEB Persian v2 · Reranking · Persian69.6#30
JMTEB v2 · Clustering · Japanese48.8#39
JMTEB v2 · STS · Japanese77#60
LongEmbed · Mean over tasks · English37.7#88
LongEmbed · Mean over task types · English37.7#88
LongEmbed · Retrieval · English37.7#88
MTEB German v1 · Mean over tasks · German51.8#24
MTEB German v1 · Mean over task types · German51.9#22
MTEB German v1 · Clustering · German31.1#41
MTEB German v1 · Retrieval · German44.4#32
MTEB German v1 · Classification · German64.9#43
MTEB German v1 · STS · German68.9#28
MTEB German v1 · Pair Classification · German52.8#46
MTEB German v1 · Reranking · German49.1#33
MTEB Europe v1 · Retrieval · multilingual (25 languages)50.9#37
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)81.1#75
MTEB Europe v1 · Classification · multilingual (23 languages)53#53
MTEB Europe v1 · Clustering · multilingual (29 languages)36.3#96
MTEB Europe v1 · Instruction Reranking · English-1.8#116
MTEB Europe v1 · Pair Classification · multilingual (11 languages)85#52
MTEB Europe v1 · Reranking · multilingual (12 languages)56.2#65
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)13.4#83
MTEB French v1 · Mean over tasks · multilingual (2 languages)56.1#22
MTEB French v1 · Mean over task types · multilingual (2 languages)57.4#21
MTEB French v1 · STS · French76.5#31
MTEB French v1 · Retrieval · multilingual (2 languages)51.5#31
MTEB French v1 · Reranking · French79.5#28
MTEB French v1 · Clustering · French40.1#67
MTEB French v1 · Classification · French64#41
MTEB French v1 · Summarization · French31.8#10
MTEB French v1 · Pair Classification · French58.6#84
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)60#30
MTEB Indic v1 · Mean over task types · multilingual (25 languages)56.4#34
MTEB Indic v1 · Classification · multilingual (8 languages)62.3#27
MTEB Indic v1 · Retrieval · multilingual (14 languages)72#41
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)48.7#44
MTEB Indic v1 · Reranking · multilingual (2 languages)82.4#66
MTEB Indic v1 · Pair Classification · Hindi61.6#90
MTEB Indic v1 · STS · multilingual (13 languages)34.5#61
MTEB Indic v1 · Clustering · multilingual (21 languages)33.2#57
MTEB Korean v2 · Reranking · Korean53.1#38
MTEB Korean v2 · Classification · Korean52#47
MTEB Dutch v1 · Mean over tasks · Dutch50.2#56
MTEB Dutch v1 · Mean over task types · Dutch57.1#57
MTEB Dutch v1 · Classification · Dutch55.4#61
MTEB Dutch v1 · Clustering · Dutch30.3#51
MTEB Dutch v1 · Retrieval · Dutch52.4#55
MTEB Dutch v1 · STS · Dutch70.8#63
MTEB Dutch v1 · Multilabel Classification · Dutch34.3#51
MTEB Dutch v1 · Pair Classification · Dutch71#59
MTEB Dutch v1 · Reranking · Dutch85.6#83
MTEB Polish v1 · Pair Classification · Polish75.9#65
MTEB Polish v1 · Classification · Polish47.1#64
MTEB Polish v1 · STS · Polish62.5#47
MTEB Portuguese v1 · Multilabel Classification · Portuguese18.3#136
MTEB Law v1 · Mean over tasks · multilingual (3 languages)45.8#57
MTEB Law v1 · Mean over task types · multilingual (3 languages)45.8#57
MTEB Law v1 · Retrieval · multilingual (3 languages)45.8#57
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)50.9#38
MTEB Medical v1 · Mean over task types · multilingual (10 languages)49.4#43
MTEB Medical v1 · Retrieval · multilingual (10 languages)53.5#38
MTEB Medical v1 · Clustering · English34.2#143
MTEB Medical v1 · Reranking · Mandarin Chinese60.3#90
FollowIR · Mean over tasks · English-1.8#116
FollowIR · Mean over task types · English-1.8#116
FollowIR · Instruction Reranking · English-1.8#116
MTEB Spanish v1 · Pair Classification · Spanish61.9#85
MTEB Spanish v1 · Clustering · Spanish44#49
MTEB Spanish v1 · Reranking · Spanish60.6#30
MTEB Thai v1 · Clustering · Thai42.6#63
MTEB Thai v1 · Pair Classification · Thai64#86
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)37.6#59
MTEB Scandinavian v1 · Classification · multilingual (6 languages)51.9#70
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)66.6#79
CoIR · Mean over tasks · multilingual (9 languages)45.4#54
CoIR · Mean over task types · multilingual (9 languages)45.4#54
CoIR · Retrieval · multilingual (9 languages)45.4#54
MTEB Code v1 · Mean over tasks · multilingual (15 languages)48.4#47
MTEB Code v1 · Mean over task types · multilingual (15 languages)48.4#47
MTEB Code v1 · Retrieval · multilingual (15 languages)48.4#47
MTEB Russian v1.1 · Mean over tasks · Russian54.4#39
MTEB Russian v1.1 · Mean over task types · Russian54.4#38
MTEB Russian v1.1 · Classification · Russian52.5#75
MTEB Russian v1.1 · STS · Russian65.9#61
MTEB Russian v1.1 · Reranking · Russian62.2#46
MTEB Russian v1.1 · Clustering · Russian50.9#64
MTEB Russian v1.1 · Pair Classification · Russian56.3#78
MTEB Russian v1.1 · Retrieval · Russian62.6#33
MTEB Russian v1.1 · Multilabel Classification · Russian30.2#77
RTEB French beta · Mean over tasks · multilingual (2 languages)40.8#69
RTEB German beta · Mean over tasks · German36.8#91
RTEB Law beta · Mean over tasks · multilingual (4 languages)35.4#95
MTEB multilingual v2 · Classification · multilingual (119 languages)54.1#70
MTEB multilingual v2 · Clustering · multilingual (208 languages)41.4#78
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)75.7#80
MTEB multilingual v2 · Retrieval · multilingual (120 languages)52.2#77
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)58.5#73
MTEB multilingual v2 · Instruction Reranking · English-1.8#116
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)17.7#85
MTEB multilingual v2 · Reranking · multilingual (22 languages)59.9#68

FAQ

How much does Granite Embedding 278M Multilingual cost?›

There is no per-unit API price: price not verified.

How good is Granite Embedding 278M Multilingual, and what is it best at?›

#96 of 200 in Embeddings.

Is Granite Embedding 278M Multilingual better than Bekko Embedding v1 A25m?›

On MTEB French v1 · Classification · French, Granite Embedding 278M Multilingual scores 64 vs 64.1 — about the same.

When was Granite Embedding 278M Multilingual released? Is there a newer version?›

Released 2024-12-18. It is the current version in its line.

Is Granite Embedding 278M Multilingual open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Granite Embedding 278M Multilingual locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Granite Embedding 278M Multilingual?›

Granite Embedding 278M Multilingual is an open-weights embeddings & retrieval model from IBM, released Dec 2024.

What are the best alternatives to Granite Embedding 278M Multilingual?›

Multilingual E5 Large Instruct (better), F2LLM v2 8B (open weights).