m

Potion Base 8M

Oct 2024
mPotion Base 8M
Compare in
on
self-host onlyprice
31.1MTEB English v2
Oct 2024released

Rankingconfiguration unstated?

Full ranking →
1Ko Embed Cls84.42PwC Embedding Expr733Qwen 3 Embedding 8B69.14F2LLM v2 14B68.65F2LLM v2 8B67.6
···
142German Semantic STS v218.8143Potion Base 8M18.4144M2V Base Glove18.4

Strong at

C
Embeddings & Retrieval#161 of 200

Alternatives?

ModelScoreCostPriceWhat changes
sBetterAll Mpnet Base v2unstatedOpen+26%—$0.005Memory (4-bit): 0 GB → 0.1 GBNOpenKo Embed Cls×4.6——Memory (4-bit): 0 GB → 0.3 GBiBetterE5 Base v2unstatedOpen+25%—$0.005Memory (4-bit): 0 GB → 0.1 GBsBetterAll MiniLM L12 v2unstatedOpen+18%—$0.005tBetterGte BaseunstatedOpen+18%—$0.005Memory (4-bit): 0 GB → 0.1 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English30.4#164
BEIR · Mean over task types · English30.4#164
BEIR · Retrieval · English30.4#164
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese17.9#76
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese10.1#73
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese56.1#74
MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese41.9#44
MTEB Persian v2 · Reranking · Persian35.3#89
JMTEB v2 · Clustering · Japanese11.5#135
JMTEB v2 · STS · Japanese55.7#121
LongEmbed · Mean over tasks · English32.6#115
LongEmbed · Mean over task types · English32.6#115
LongEmbed · Retrieval · English32.6#115
MTEB German v1 · Clustering · German9.8#148
MTEB German v1 · Classification · German46.3#127
MTEB German v1 · Pair Classification · German47.3#166
MTEB German v1 · Reranking · German13.9#126
MTEB Europe v1 · Retrieval · multilingual (25 languages)31.5#111
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)19.2#162
MTEB Europe v1 · Classification · multilingual (23 languages)46.4#113
MTEB Europe v1 · Clustering · multilingual (29 languages)27.1#145
MTEB Europe v1 · Instruction Reranking · English0.2#54
MTEB Europe v1 · Pair Classification · multilingual (11 languages)78#125
MTEB Europe v1 · Reranking · multilingual (12 languages)39.5#153
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)4.1#164
MTEB French v1 · Classification · French44.7#111
MTEB French v1 · Pair Classification · French49.7#186
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)32.2#92
MTEB Indic v1 · Mean over task types · multilingual (25 languages)24.9#74
MTEB Indic v1 · Classification · multilingual (8 languages)41.2#125
MTEB Indic v1 · Retrieval · multilingual (14 languages)16.2#87
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)1#152
MTEB Indic v1 · Reranking · multilingual (2 languages)57.8#107
MTEB Indic v1 · Pair Classification · Hindi54.7#117
MTEB Indic v1 · STS · multilingual (13 languages)0.8#160
MTEB Indic v1 · Clustering · multilingual (21 languages)2.8#168
MTEB Korean v2 · Reranking · Korean18.8#73
MTEB Korean v2 · Classification · Korean18.4#143
MTEB Dutch v1 · Mean over tasks · Dutch30.1#114
MTEB Dutch v1 · Mean over task types · Dutch40.9#114
MTEB Dutch v1 · Classification · Dutch40.4#118
MTEB Dutch v1 · Clustering · Dutch10.6#123
MTEB Dutch v1 · Retrieval · Dutch21.5#112
MTEB Dutch v1 · STS · Dutch54.9#112
MTEB Dutch v1 · Multilabel Classification · Dutch22.6#117
MTEB Dutch v1 · Pair Classification · Dutch64.5#75
MTEB Dutch v1 · Reranking · Dutch71.5#170
MTEB Polish v1 · Pair Classification · Polish61.8#118
MTEB Polish v1 · Classification · Polish38.2#127
MTEB Portuguese v1 · Multilabel Classification · Portuguese15.4#183
MTEB Law v1 · Mean over tasks · multilingual (3 languages)34.8#124
MTEB Law v1 · Mean over task types · multilingual (3 languages)34.8#124
MTEB Law v1 · Retrieval · multilingual (3 languages)34.8#124
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)27.5#107
MTEB Medical v1 · Mean over task types · multilingual (10 languages)24.5#106
MTEB Medical v1 · Retrieval · multilingual (10 languages)28.3#109
MTEB Medical v1 · Clustering · English29.9#198
MTEB Medical v1 · Reranking · Mandarin Chinese15.2#162
FollowIR · Mean over tasks · English0.2#54
FollowIR · Mean over task types · English0.2#54
FollowIR · Instruction Reranking · English0.2#54
MTEB Spanish v1 · Pair Classification · Spanish53.8#165
MTEB Spanish v1 · Reranking · Spanish17.5#128
MTEB Thai v1 · Clustering · Thai3.5#160
MTEB Thai v1 · Pair Classification · Thai51.9#125
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)19.5#160
MTEB Scandinavian v1 · Classification · multilingual (6 languages)47#130
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)56.6#160
MTEB Russian v1.1 · Reranking · Russian21.7#112
MTEB Russian v1.1 · Pair Classification · Russian51.3#125
RTEB Finnish beta · Mean over tasks · English29.1#85
RTEB French beta · Mean over tasks · multilingual (2 languages)2.6#190
RTEB German beta · Mean over tasks · German16.1#141
RTEB Health beta · Mean over tasks · multilingual (4 languages)13.8#86
RTEB Law beta · Mean over tasks · multilingual (4 languages)27#165
MTEB multilingual v2 · Classification · multilingual (119 languages)44.5#138
MTEB multilingual v2 · Clustering · multilingual (208 languages)32.4#138
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)71.1#149
MTEB multilingual v2 · Retrieval · multilingual (120 languages)28.6#148
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)16.1#161
MTEB multilingual v2 · Instruction Reranking · English0.2#54
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)11.6#173
MTEB multilingual v2 · Reranking · multilingual (22 languages)39.1#143

FAQ

How much does Potion Base 8M cost?›

There is no per-unit API price: self-host only.

Is Potion Base 8M free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Potion Base 8M, and what is it best at?›

#161 of 200 in Embeddings.

Is Potion Base 8M better than German Semantic STS v2?›

On MTEB Korean v2 · Classification · Korean, Potion Base 8M scores 18.4 vs 18.8 — about the same.

When was Potion Base 8M released? Is there a newer version?›

Released 2024-10-29. It is the current version in its line.

Is Potion Base 8M open source?›

Yes, the weights are open (MIT licence).

Can I run Potion Base 8M locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Potion Base 8M?›

Potion Base 8M is an open-weights embeddings & retrieval model from minishlab, released Oct 2024.

What are the best alternatives to Potion Base 8M?›

All Mpnet Base v2 (better), Ko Embed Cls (open weights).