i

Udever Bloom 3B

Oct 2023
iUdever Bloom 3B
Compare in
on
self-host onlyprice
84.1MTEB English v2
Oct 2023released
2,560Dimensions
en, es, fr +28Languages

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B78.82FlowVec v1783F2LLM v2 8B77.94F2LLM v2 4B76.65F2LLM v2 1.7B74.2
···
50Hinvec46.951Udever Bloom 3B46.852Udever Bloom 7b145.6

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
Licencehttps://huggingface.co/spaces/bigscience/licensecommercial use with conditions

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English47.7#120
BEIR · Mean over task types · English47.7#120
BEIR · Retrieval · English47.7#120
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese59.8#67
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese46.2#56
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese51.6#67
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese43.2#63
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese70.7#43
JMTEB v2 · Clustering · Japanese23.6#80
JMTEB v2 · STS · Japanese53.3#131
MTEB German v1 · Classification · German52.6#78
MTEB German v1 · Pair Classification · German53.2#41
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)17.2#169
MTEB Europe v1 · Instruction Reranking · English-0.7#79
MTEB Europe v1 · Pair Classification · multilingual (11 languages)81.2#104
MTEB Europe v1 · Reranking · multilingual (12 languages)33#167
MTEB French v1 · Summarization · French29.6#100
MTEB French v1 · Pair Classification · French65.2#29
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)46.8#51
MTEB Indic v1 · Mean over task types · multilingual (25 languages)32.5#52
MTEB Indic v1 · Classification · multilingual (8 languages)60.3#39
MTEB Indic v1 · Retrieval · multilingual (14 languages)37.8#66
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)6.2#81
MTEB Indic v1 · Reranking · multilingual (2 languages)64#99
MTEB Indic v1 · Pair Classification · Hindi58#102
MTEB Indic v1 · STS · multilingual (13 languages)-4.1#189
MTEB Indic v1 · Clustering · multilingual (21 languages)5.6#107
MTEB Dutch v1 · Reranking · Dutch55.8#195
MTEB Polish v1 · Pair Classification · Polish62.3#115
MTEB Portuguese v1 · Multilabel Classification · Portuguese18.9#117
MTEB Medical v1 · Clustering · English30.8#190
MTEB Medical v1 · Reranking · Mandarin Chinese44.9#103
FollowIR · Mean over tasks · English-0.7#79
FollowIR · Mean over task types · English-0.7#79
FollowIR · Instruction Reranking · English-0.7#79
MTEB Spanish v1 · Pair Classification · Spanish61.4#90
MTEB Thai v1 · Clustering · Thai2.2#189
MTEB Thai v1 · Pair Classification · Thai53.7#108
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)42#201
MTEB Russian v1.1 · Pair Classification · Russian50.8#130
MTEB Russian v1.1 · Multilabel Classification · Russian25.9#123
RTEB French beta · Mean over tasks · multilingual (2 languages)4#184
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)72.9#101
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)13.8#169
MTEB multilingual v2 · Instruction Reranking · English-0.7#79
MTEB multilingual v2 · Reranking · multilingual (22 languages)35.7#157

FAQ

How much does Udever Bloom 3B cost?›

There is no per-unit API price: self-host only.

Is Udever Bloom 3B free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Udever Bloom 3B, and what is it best at?›

#119 of 238 in Embeddings.

Is Udever Bloom 3B better than Hinvec?›

On MTEB Indic v1 · Mean over tasks · multilingual (25 languages), Udever Bloom 3B scores 46.8 vs 46.9 — about the same.

When was Udever Bloom 3B released? Is there a newer version?›

Released 2023-10-24. It is the current version in its line.

Is Udever Bloom 3B open source?›

Yes, the weights are open (https://huggingface.co/spaces/bigscience/license licence).

Can I run Udever Bloom 3B locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Udever Bloom 3B?›

Udever Bloom 3B is an open-weights embeddings & retrieval model from izhx, released Oct 2023.

What are the best alternatives to Udever Bloom 3B?›

Multilingual E5 Large Instruct (better), FlowVec v1 (open weights).