i

Udever Bloom 560M

Oct 2023
iUdever Bloom 560M
Compare in
on
self-host onlyprice
81.1MTEB English v2
Oct 2023released
1,024Dimensions
en, es, fr +28Languages

Rankingconfiguration unstated?

Full ranking →
1Gte Qwen2 7B Instruct65.32German Semantic STS v263.23Gte Qwen1.5 7B Instruct624F2LLM v2 14B59.85F2LLM v2 8B59.1
···
63Arabic Labse Matryoshka51.364Udever Bloom 560M51.265Dmeta Embedding Zh Small51.2

Alternatives?

ModelScoreCostPriceWhat changes
iBetterMultilingual E5 LargeunstatedOpen+6%—$0.01OpenGte Qwen2 7B Instructunstated+27%——Languages: not verified+1BetterJina Embeddings v5 Text NanounstatedOpen+10%—$0.02Languages: not verifiedBetterText Embedding 3 Smallunstated+7%—$0.02Languages: not verifiediBetterE5 Mistral 7B InstructunstatedOpen+8%—$0.022Languages: loses es, fr, zh +27+1

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
Licencehttps://huggingface.co/spaces/bigscience/licensecommercial use with conditions

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English41.2#142
BEIR · Mean over task types · English41.2#142
BEIR · Retrieval · English41.2#142
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese46.2#75
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese42.8#63
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese45.6#68
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese42.4#64
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese67#49
MTEB Persian v2 · Reranking · Persian28#114
JMTEB v2 · Clustering · Japanese8.2#155
JMTEB v2 · STS · Japanese35.7#146
MTEB German v1 · Clustering · German5.2#162
MTEB German v1 · Pair Classification · German51.2#64
MTEB German v1 · Reranking · German3.3#148
MTEB Europe v1 · STS · multilingual (8 languages)60.9#66
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)15.1#176
MTEB Europe v1 · Instruction Reranking · English-0.8#82
MTEB Europe v1 · Pair Classification · multilingual (11 languages)75.1#133
MTEB Europe v1 · Reranking · multilingual (12 languages)26.7#180
MTEB French v1 · STS · French52#101
MTEB French v1 · Retrieval · multilingual (2 languages)7.9#120
MTEB French v1 · Reranking · French39#122
MTEB French v1 · Summarization · French23.6#152
MTEB French v1 · Pair Classification · French62.5#49
MTEB Indic v1 · Retrieval · multilingual (14 languages)19.8#80
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)3.5#109
MTEB Indic v1 · Reranking · multilingual (2 languages)53#121
MTEB Indic v1 · Pair Classification · Hindi56.1#111
MTEB Indic v1 · STS · multilingual (13 languages)-0#165
MTEB Indic v1 · Clustering · multilingual (21 languages)3.2#152
MTEB Korean v2 · STS · Korean41#57
MTEB Korean v2 · Reranking · Korean11.1#100
MTEB Korean v2 · Classification · Korean22.8#85
MTEB Dutch v1 · Reranking · Dutch38.6#206
MTEB Polish v1 · Pair Classification · Polish51.7#149
MTEB Portuguese v1 · Multilabel Classification · Portuguese16#176
MTEB Medical v1 · Clustering · English23.7#222
MTEB Medical v1 · Reranking · Mandarin Chinese31.6#109
FollowIR · Mean over tasks · English-0.8#82
FollowIR · Mean over task types · English-0.8#82
FollowIR · Instruction Reranking · English-0.8#82
MTEB Spanish v1 · Pair Classification · Spanish58.4#126
MTEB Spanish v1 · Reranking · Spanish11.1#137
MTEB Thai v1 · Clustering · Thai2.1#190
MTEB Thai v1 · Pair Classification · Thai51.8#127
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)36.9#206
MTEB Russian v1.1 · Reranking · Russian9.3#151
MTEB Russian v1.1 · Clustering · Russian12.5#152
MTEB Russian v1.1 · Pair Classification · Russian49.1#138
MTEB Russian v1.1 · Multilabel Classification · Russian25#145
RTEB French beta · Mean over tasks · multilingual (2 languages)2.3#194
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)71.7#127
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)10.1#175
MTEB multilingual v2 · Instruction Reranking · English-0.8#82
MTEB multilingual v2 · Reranking · multilingual (22 languages)30.8#173

FAQ

How much does Udever Bloom 560M cost?›

There is no per-unit API price: self-host only.

Is Udever Bloom 560M free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Udever Bloom 560M, and what is it best at?›

#176 of 238 in Embeddings.

Is Udever Bloom 560M better than Arabic Labse Matryoshka?›

On MTEB German v1 · Pair Classification · German, Udever Bloom 560M scores 51.2 vs 51.3 — about the same.

When was Udever Bloom 560M released? Is there a newer version?›

Released 2023-10-24. It is the current version in its line.

Is Udever Bloom 560M open source?›

Yes, the weights are open (https://huggingface.co/spaces/bigscience/license licence).

Can I run Udever Bloom 560M locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Udever Bloom 560M?›

Udever Bloom 560M is an open-weights embeddings & retrieval model from izhx, released Oct 2023.

What are the best alternatives to Udever Bloom 560M?›

Multilingual E5 Large (better), Gte Qwen2 7B Instruct (open weights).