i

Udever Bloom 1b1

Oct 2023
iUdever Bloom 1b1
Compare in
on
self-host onlyprice
83.2MTEB English v2
Oct 2023released
1,536Dimensions
en, es, fr +28Languages

Rankingconfiguration unstated?

Full ranking →
1Gte Qwen2 7B Instruct65.32German Semantic STS v263.23Gte Qwen1.5 7B Instruct624F2LLM v2 14B59.85F2LLM v2 8B59.1
···
49Sentence Croissant Alpha v0.352.750Udever Bloom 1b152.751STS Multilingual Mpnet Base v252.7

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
Licencehttps://huggingface.co/spaces/bigscience/licensecommercial use with conditions

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English45.3#128
BEIR · Mean over task types · English45.3#128
BEIR · Retrieval · English45.3#128
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese58#70
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese44.4#60
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese52.9#65
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese42.4#65
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese70#45
MTEB Persian v2 · Reranking · Persian32.9#99
JMTEB v2 · Clustering · Japanese24.4#79
JMTEB v2 · STS · Japanese53.4#129
MTEB German v1 · Clustering · German19.1#111
MTEB German v1 · Pair Classification · German52.7#50
MTEB German v1 · Reranking · German7.3#136
MTEB Europe v1 · STS · multilingual (8 languages)63.6#56
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)21.3#161
MTEB Europe v1 · Instruction Reranking · English-1.1#89
MTEB Europe v1 · Pair Classification · multilingual (11 languages)80.6#106
MTEB Europe v1 · Reranking · multilingual (12 languages)35.4#164
MTEB French v1 · STS · French63.7#85
MTEB French v1 · Retrieval · multilingual (2 languages)21.5#109
MTEB French v1 · Reranking · French43.3#119
MTEB French v1 · Summarization · French29.5#108
MTEB French v1 · Pair Classification · French64.4#36
MTEB Indic v1 · Retrieval · multilingual (14 languages)41.9#64
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)11.1#63
MTEB Indic v1 · Reranking · multilingual (2 languages)66.5#97
MTEB Indic v1 · Pair Classification · Hindi58#101
MTEB Indic v1 · STS · multilingual (13 languages)10.7#100
MTEB Indic v1 · Clustering · multilingual (21 languages)9.3#102
MTEB Korean v2 · STS · Korean50#48
MTEB Korean v2 · Reranking · Korean21.1#69
MTEB Korean v2 · Classification · Korean26.7#67
MTEB Dutch v1 · Reranking · Dutch55.9#193
MTEB Polish v1 · Pair Classification · Polish60.8#129
MTEB Portuguese v1 · Multilabel Classification · Portuguese19.9#81
MTEB Medical v1 · Clustering · English32.6#169
MTEB Medical v1 · Reranking · Mandarin Chinese53.3#92
FollowIR · Mean over tasks · English-1.1#89
FollowIR · Mean over task types · English-1.1#89
FollowIR · Instruction Reranking · English-1.1#89
MTEB Spanish v1 · Pair Classification · Spanish61.4#91
MTEB Spanish v1 · Reranking · Spanish20.2#122
MTEB Thai v1 · Clustering · Thai2.1#191
MTEB Thai v1 · Pair Classification · Thai53#109
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)50.7#184
MTEB Russian v1.1 · Reranking · Russian15.1#132
MTEB Russian v1.1 · Clustering · Russian22.5#97
MTEB Russian v1.1 · Pair Classification · Russian50.9#128
MTEB Russian v1.1 · Multilabel Classification · Russian24.6#149
RTEB French beta · Mean over tasks · multilingual (2 languages)6.8#168
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)72.8#102
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)20.5#146
MTEB multilingual v2 · Instruction Reranking · English-1.1#89
MTEB multilingual v2 · Reranking · multilingual (22 languages)37#153

FAQ

How much does Udever Bloom 1b1 cost?›

There is no per-unit API price: self-host only.

Is Udever Bloom 1b1 free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Udever Bloom 1b1, and what is it best at?›

#140 of 238 in Embeddings.

Is Udever Bloom 1b1 better than Sentence Croissant Alpha v0.3?›

On MTEB German v1 · Pair Classification · German, Udever Bloom 1b1 scores 52.7 vs 52.7 — about the same.

When was Udever Bloom 1b1 released? Is there a newer version?›

Released 2023-10-24. It is the current version in its line.

Is Udever Bloom 1b1 open source?›

Yes, the weights are open (https://huggingface.co/spaces/bigscience/license licence).

Can I run Udever Bloom 1b1 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Udever Bloom 1b1?›

Udever Bloom 1b1 is an open-weights embeddings & retrieval model from izhx, released Oct 2023.

What are the best alternatives to Udever Bloom 1b1?›

Jina Embeddings v5 Text Nano (better), Gte Qwen2 7B Instruct (open weights).