M

Bulbasaur

Apr 2024
MBulbasaur
Compare in
on
self-host onlyprice
37MTEB English v2
Apr 2024released
384Dimensions
1K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B672F2LLM v2 8B66.83F2LLM v2 4B66.14F2LLM v2 1.7B65.15Jina Embeddings v5 Text Nano64.8
···
73All MiniLM L6 v236.774Bulbasaur36.775Gte Micro v436.4

Strong at

C
Embeddings & Retrieval#153 of 200

Alternatives?

ModelScoreCostPriceWhat changes
iBetterE5 Base v2unstatedOpen+16%—$0.005Memory (4-bit): 0 GB → 0.1 GBcOpenF2LLM v2 8Bunstated+82%——Memory (4-bit): 0 GB → 4.5 GBtBetterGte BaseunstatedOpen+11%—$0.005Memory (4-bit): 0 GB → 0.1 GBBetterBge Base En v1.5unstatedOpen+10%—$0.005Memory (4-bit): 0 GB → 0.1 GBsBetterAll Mpnet Base v2unstatedOpen+6%—$0.005Max input: 1K tokens → 0K tokens+1

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English37.3#152
BEIR · Mean over task types · English37.3#152
BEIR · Retrieval · English37.3#152
MTEB Persian v2 · Reranking · Persian26.2#117
JMTEB v2 · Clustering · Japanese11.4#136
JMTEB v2 · STS · Japanese59.6#109
LongEmbed · Mean over tasks · English31.2#120
LongEmbed · Mean over task types · English31.2#120
LongEmbed · Retrieval · English31.2#120
MTEB German v1 · Mean over tasks · German36.7#74
MTEB German v1 · Mean over task types · German34.6#75
MTEB German v1 · Clustering · German16.1#122
MTEB German v1 · Retrieval · German24.4#87
MTEB German v1 · Classification · German54.6#69
MTEB German v1 · STS · German46#99
MTEB German v1 · Pair Classification · German49#130
MTEB German v1 · Reranking · German17.5#114
MTEB Europe v1 · Retrieval · multilingual (25 languages)32.7#106
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)26.8#151
MTEB Europe v1 · Classification · multilingual (23 languages)50.1#91
MTEB Europe v1 · Clustering · multilingual (29 languages)29.8#139
MTEB Europe v1 · Instruction Reranking · English-3.2#170
MTEB Europe v1 · Pair Classification · multilingual (11 languages)79.4#120
MTEB Europe v1 · Reranking · multilingual (12 languages)43.3#141
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)9.8#129
MTEB French v1 · Mean over tasks · multilingual (2 languages)42.9#78
MTEB French v1 · Mean over task types · multilingual (2 languages)44.7#78
MTEB French v1 · STS · French64.9#79
MTEB French v1 · Retrieval · multilingual (2 languages)24.7#102
MTEB French v1 · Reranking · French49.6#113
MTEB French v1 · Clustering · French34.3#92
MTEB French v1 · Classification · French55.1#74
MTEB French v1 · Summarization · French30.1#84
MTEB French v1 · Pair Classification · French53.9#164
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)31.9#99
MTEB Indic v1 · Mean over task types · multilingual (25 languages)21.9#100
MTEB Indic v1 · Classification · multilingual (8 languages)43.1#95
MTEB Indic v1 · Retrieval · multilingual (14 languages)7.5#132
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)2.9#121
MTEB Indic v1 · Reranking · multilingual (2 languages)41.2#154
MTEB Indic v1 · Pair Classification · Hindi52.6#149
MTEB Indic v1 · STS · multilingual (13 languages)3.8#136
MTEB Indic v1 · Clustering · multilingual (21 languages)2.7#175
MTEB Korean v2 · Reranking · Korean13.9#85
MTEB Korean v2 · Classification · Korean22.9#83
MTEB Dutch v1 · Reranking · Dutch75.6#151
MTEB Polish v1 · Pair Classification · Polish62.3#114
MTEB Polish v1 · Classification · Polish43#77
MTEB Polish v1 · STS · Polish52.1#91
MTEB Portuguese v1 · Multilabel Classification · Portuguese15.8#180
MTEB Law v1 · Mean over tasks · multilingual (3 languages)35.8#115
MTEB Law v1 · Mean over task types · multilingual (3 languages)35.8#115
MTEB Law v1 · Retrieval · multilingual (3 languages)35.8#115
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)30.5#101
MTEB Medical v1 · Mean over task types · multilingual (10 languages)28.2#99
MTEB Medical v1 · Retrieval · multilingual (10 languages)31#100
MTEB Medical v1 · Clustering · English33.3#160
MTEB Medical v1 · Reranking · Mandarin Chinese20.2#136
FollowIR · Mean over tasks · English-3.2#170
FollowIR · Mean over task types · English-3.2#170
FollowIR · Instruction Reranking · English-3.2#170
MTEB Spanish v1 · Pair Classification · Spanish56.5#145
MTEB Spanish v1 · Clustering · Spanish35.6#103
MTEB Spanish v1 · Reranking · Spanish23.4#112
MTEB Thai v1 · Clustering · Thai3.2#173
MTEB Thai v1 · Pair Classification · Thai51.1#160
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)25.3#140
MTEB Scandinavian v1 · Classification · multilingual (6 languages)48.9#89
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)62.6#112
MTEB Russian v1.1 · Mean over tasks · Russian22.8#93
MTEB Russian v1.1 · Mean over task types · Russian23#94
MTEB Russian v1.1 · Classification · Russian28.7#122
MTEB Russian v1.1 · STS · Russian32.9#120
MTEB Russian v1.1 · Reranking · Russian14.5#136
MTEB Russian v1.1 · Clustering · Russian12.4#153
MTEB Russian v1.1 · Pair Classification · Russian46.2#179
MTEB Russian v1.1 · Retrieval · Russian0.7#101
MTEB Russian v1.1 · Multilabel Classification · Russian25.9#125
RTEB French beta · Mean over tasks · multilingual (2 languages)6.4#172
RTEB German beta · Mean over tasks · German12.2#167
RTEB Law beta · Mean over tasks · multilingual (4 languages)29.4#149
MTEB multilingual v2 · Classification · multilingual (119 languages)47.8#107
MTEB multilingual v2 · Clustering · multilingual (208 languages)35.1#132
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)71.9#116
MTEB multilingual v2 · Retrieval · multilingual (120 languages)29.9#147
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)20.4#148
MTEB multilingual v2 · Instruction Reranking · English-3.2#170
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)14.4#146
MTEB multilingual v2 · Reranking · multilingual (22 languages)39.1#144

FAQ

How much does Bulbasaur cost?›

There is no per-unit API price: self-host only.

Is Bulbasaur free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Bulbasaur, and what is it best at?›

#153 of 200 in Embeddings.

Is Bulbasaur better than All MiniLM L6 v2?›

On MTEB German v1 · Mean over tasks · German, Bulbasaur scores 36.7 vs 36.7 — about the same.

When was Bulbasaur released? Is there a newer version?›

Released 2024-04-27. It is the current version in its line.

Is Bulbasaur open source?›

Yes, the weights are open (MIT licence).

Can I run Bulbasaur locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Bulbasaur?›

Bulbasaur is an open-weights embeddings & retrieval model from Mihaiii, released Apr 2024.

What are the best alternatives to Bulbasaur?›

E5 Base v2 (better), F2LLM v2 8B (open weights).