m

Potion Base 2M

Oct 2024
mPotion Base 2M
Compare in
on
self-host onlyprice
23MTEB English v2
Oct 2024released

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B76.72F2LLM v2 8B75.73FlowVec v175.14F2LLM v2 4B74.55F2LLM v2 1.7B71.6
···
130USER Base40.7131Potion Base 2M40.3132Rubert Tiny Turbo40.1

Strong at

C
Embeddings & Retrieval#181 of 200

Alternatives?

ModelScoreCostPriceWhat changes
iBetterE5 Base v2unstatedOpen+15%—$0.005Memory (4-bit): 0 GB → 0.1 GBcOpenF2LLM v2 8Bunstated+88%——Memory (4-bit): 0 GB → 4.5 GBsBetterAll MiniLM L6 v2unstatedOpen+9%—$0.005BetterBge Base En v1.5unstatedOpen+7%—$0.005Memory (4-bit): 0 GB → 0.1 GBiBetterMultilingual E5 Large InstructunstatedOpen+66%—$0.01Memory (4-bit): 0 GB → 0.3 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English22.9#180
BEIR · Mean over task types · English22.9#180
BEIR · Retrieval · English22.9#180
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese18#75
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese9.8#76
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese55.9#76
MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese41.1#46
MTEB Persian v2 · Reranking · Persian34.2#95
JMTEB v2 · Clustering · Japanese11.2#139
JMTEB v2 · STS · Japanese54.8#127
LongEmbed · Mean over tasks · English27.2#136
LongEmbed · Mean over task types · English27.2#136
LongEmbed · Retrieval · English27.2#136
MTEB German v1 · Clustering · German8.2#156
MTEB German v1 · Classification · German39.5#155
MTEB German v1 · Pair Classification · German47.3#165
MTEB German v1 · Reranking · German10.4#132
MTEB Europe v1 · Retrieval · multilingual (25 languages)25.8#123
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)15.4#174
MTEB Europe v1 · Classification · multilingual (23 languages)43.6#126
MTEB Europe v1 · Clustering · multilingual (29 languages)25.4#154
MTEB Europe v1 · Instruction Reranking · English0.6#46
MTEB Europe v1 · Pair Classification · multilingual (11 languages)76.5#132
MTEB Europe v1 · Reranking · multilingual (12 languages)36.9#160
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)3.7#171
MTEB French v1 · Classification · French37.7#124
MTEB French v1 · Pair Classification · French49.8#185
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)31.4#108
MTEB Indic v1 · Mean over task types · multilingual (25 languages)24.2#81
MTEB Indic v1 · Classification · multilingual (8 languages)40.3#131
MTEB Indic v1 · Retrieval · multilingual (14 languages)14.4#96
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)0.9#154
MTEB Indic v1 · Reranking · multilingual (2 languages)56#111
MTEB Indic v1 · Pair Classification · Hindi54.5#120
MTEB Indic v1 · STS · multilingual (13 languages)0.3#163
MTEB Indic v1 · Clustering · multilingual (21 languages)2.8#171
MTEB Korean v2 · Reranking · Korean13.4#89
MTEB Korean v2 · Classification · Korean17.6#147
MTEB Dutch v1 · Mean over tasks · Dutch26.2#118
MTEB Dutch v1 · Mean over task types · Dutch38#118
MTEB Dutch v1 · Classification · Dutch36.7#129
MTEB Dutch v1 · Clustering · Dutch9.9#128
MTEB Dutch v1 · Retrieval · Dutch13.6#119
MTEB Dutch v1 · STS · Dutch53.3#119
MTEB Dutch v1 · Multilabel Classification · Dutch21.4#125
MTEB Dutch v1 · Pair Classification · Dutch64.8#71
MTEB Dutch v1 · Reranking · Dutch66#185
MTEB Polish v1 · Pair Classification · Polish59.4#135
MTEB Polish v1 · Classification · Polish35#136
MTEB Portuguese v1 · Multilabel Classification · Portuguese15.5#182
MTEB Law v1 · Mean over tasks · multilingual (3 languages)29.4#141
MTEB Law v1 · Mean over task types · multilingual (3 languages)29.4#141
MTEB Law v1 · Retrieval · multilingual (3 languages)29.4#141
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)22.2#119
MTEB Medical v1 · Mean over task types · multilingual (10 languages)21.5#117
MTEB Medical v1 · Retrieval · multilingual (10 languages)21.6#122
MTEB Medical v1 · Clustering · English28.4#207
MTEB Medical v1 · Reranking · Mandarin Chinese14.5#165
FollowIR · Mean over tasks · English0.6#46
FollowIR · Mean over task types · English0.6#46
FollowIR · Instruction Reranking · English0.6#46
MTEB Spanish v1 · Pair Classification · Spanish53.6#168
MTEB Spanish v1 · Reranking · Spanish14.7#134
MTEB Thai v1 · Clustering · Thai3.8#139
MTEB Thai v1 · Pair Classification · Thai52.2#118
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)19.3#163
MTEB Scandinavian v1 · Classification · multilingual (6 languages)44.7#146
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)48.7#190
MTEB Russian v1.1 · Reranking · Russian20.7#118
MTEB Russian v1.1 · Pair Classification · Russian51.2#127
RTEB Finnish beta · Mean over tasks · English23.1#91
RTEB French beta · Mean over tasks · multilingual (2 languages)1.3#202
RTEB German beta · Mean over tasks · German10.1#179
RTEB Health beta · Mean over tasks · multilingual (4 languages)8.9#92
RTEB Law beta · Mean over tasks · multilingual (4 languages)21.6#188
MTEB multilingual v2 · Classification · multilingual (119 languages)42.3#148
MTEB multilingual v2 · Clustering · multilingual (208 languages)31#145
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)70.4#161
MTEB multilingual v2 · Retrieval · multilingual (120 languages)24#160
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)12.2#174
MTEB multilingual v2 · Instruction Reranking · English0.6#46
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)11.5#174
MTEB multilingual v2 · Reranking · multilingual (22 languages)37.4#152

FAQ

How much does Potion Base 2M cost?›

There is no per-unit API price: self-host only.

Is Potion Base 2M free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Potion Base 2M, and what is it best at?›

#181 of 200 in Embeddings.

Is Potion Base 2M better than USER Base?›

On MTEB Indic v1 · Classification · multilingual (8 languages), Potion Base 2M scores 40.3 vs 40.7 — about the same.

When was Potion Base 2M released? Is there a newer version?›

Released 2024-10-29. It is the current version in its line.

Is Potion Base 2M open source?›

Yes, the weights are open (MIT licence).

Can I run Potion Base 2M locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Potion Base 2M?›

Potion Base 2M is an open-weights embeddings & retrieval model from minishlab, released Oct 2024.

What are the best alternatives to Potion Base 2M?›

E5 Base v2 (better), F2LLM v2 8B (open weights).