m

Potion Base 4M

Oct 2024
mPotion Base 4M
Compare in
on
self-host onlyprice
28.4MTEB English v2
Oct 2024released

Rankingconfiguration unstated?

Full ranking →
1Qwen Indic v194.92FlowVec v192.43F2LLM v2 14B91.84F2LLM v2 8B90.95F2LLM v2 4B89.1
···
87Potion Base 8M16.288Potion Base 4M15.989GIST Large Embedding v015.9

Strong at

C
Embeddings & Retrieval#165 of 200

Alternatives?

ModelScoreCostPriceWhat changes
iBetterE5 Base v2unstatedOpen+49%—$0.005Memory (4-bit): 0 GB → 0.1 GBLOpenQwen Indic v1×6——Memory (4-bit): 0 GB → 4.5 GBiBetterMultilingual E5 Large InstructunstatedOpen×5.3—$0.01Memory (4-bit): 0 GB → 0.3 GBiBetterMultilingual E5 LargeunstatedOpen×5.2—$0.01Memory (4-bit): 0 GB → 0.3 GBiBetterE5 Large v2unstatedOpen+66%—$0.01Memory (4-bit): 0 GB → 0.2 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English27.9#170
BEIR · Mean over task types · English27.9#170
BEIR · Retrieval · English27.9#170
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese18#74
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese10#75
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese55.9#75
MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese41.8#45
MTEB Persian v2 · Reranking · Persian34.9#93
JMTEB v2 · Clustering · Japanese11.7#134
JMTEB v2 · STS · Japanese55.5#123
LongEmbed · Mean over tasks · English31.2#119
LongEmbed · Mean over task types · English31.2#119
LongEmbed · Retrieval · English31.2#119
MTEB German v1 · Clustering · German9.3#150
MTEB German v1 · Classification · German43.7#139
MTEB German v1 · Pair Classification · German47.3#164
MTEB German v1 · Reranking · German12.5#130
MTEB Europe v1 · Retrieval · multilingual (25 languages)29.7#113
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)17.7#167
MTEB Europe v1 · Classification · multilingual (23 languages)45.3#115
MTEB Europe v1 · Clustering · multilingual (29 languages)26.9#146
MTEB Europe v1 · Instruction Reranking · English0.6#45
MTEB Europe v1 · Pair Classification · multilingual (11 languages)77.6#126
MTEB Europe v1 · Reranking · multilingual (12 languages)38.7#154
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)4#166
MTEB French v1 · Classification · French42.3#115
MTEB French v1 · Pair Classification · French49.8#184
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)32#97
MTEB Indic v1 · Mean over task types · multilingual (25 languages)24.7#78
MTEB Indic v1 · Classification · multilingual (8 languages)40.9#128
MTEB Indic v1 · Retrieval · multilingual (14 languages)15.9#88
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)1#153
MTEB Indic v1 · Reranking · multilingual (2 languages)57.3#110
MTEB Indic v1 · Pair Classification · Hindi54.5#119
MTEB Indic v1 · STS · multilingual (13 languages)0.8#161
MTEB Indic v1 · Clustering · multilingual (21 languages)2.7#173
MTEB Korean v2 · Reranking · Korean14.2#83
MTEB Korean v2 · Classification · Korean17.9#146
MTEB Dutch v1 · Mean over tasks · Dutch28.8#116
MTEB Dutch v1 · Mean over task types · Dutch39.9#116
MTEB Dutch v1 · Classification · Dutch39.2#124
MTEB Dutch v1 · Clustering · Dutch10.4#124
MTEB Dutch v1 · Retrieval · Dutch18.6#117
MTEB Dutch v1 · STS · Dutch54.4#113
MTEB Dutch v1 · Multilabel Classification · Dutch22.3#121
MTEB Dutch v1 · Pair Classification · Dutch64.3#76
MTEB Dutch v1 · Reranking · Dutch69.8#177
MTEB Polish v1 · Pair Classification · Polish60.6#131
MTEB Polish v1 · Classification · Polish37#131
MTEB Portuguese v1 · Multilabel Classification · Portuguese15.8#179
MTEB Law v1 · Mean over tasks · multilingual (3 languages)32.9#131
MTEB Law v1 · Mean over task types · multilingual (3 languages)32.9#131
MTEB Law v1 · Retrieval · multilingual (3 languages)32.9#131
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)25.8#110
MTEB Medical v1 · Mean over task types · multilingual (10 languages)23.7#107
MTEB Medical v1 · Retrieval · multilingual (10 languages)26#111
MTEB Medical v1 · Clustering · English30#197
MTEB Medical v1 · Reranking · Mandarin Chinese15.1#163
FollowIR · Mean over tasks · English0.6#45
FollowIR · Mean over task types · English0.6#45
FollowIR · Instruction Reranking · English0.6#45
MTEB Spanish v1 · Pair Classification · Spanish53.8#167
MTEB Spanish v1 · Reranking · Spanish16.2#132
MTEB Thai v1 · Clustering · Thai3.6#145
MTEB Thai v1 · Pair Classification · Thai52.2#121
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)19.4#162
MTEB Scandinavian v1 · Classification · multilingual (6 languages)46.1#136
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)53.8#174
MTEB Russian v1.1 · Reranking · Russian21.3#114
MTEB Russian v1.1 · Pair Classification · Russian51.3#126
RTEB Finnish beta · Mean over tasks · English26.4#88
RTEB French beta · Mean over tasks · multilingual (2 languages)2#197
RTEB German beta · Mean over tasks · German13.1#162
RTEB Health beta · Mean over tasks · multilingual (4 languages)12#89
RTEB Law beta · Mean over tasks · multilingual (4 languages)24.9#177
MTEB multilingual v2 · Classification · multilingual (119 languages)43.7#144
MTEB multilingual v2 · Clustering · multilingual (208 languages)32.2#140
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)70.8#155
MTEB multilingual v2 · Retrieval · multilingual (120 languages)27.2#150
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)14.6#164
MTEB multilingual v2 · Instruction Reranking · English0.6#45
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)11.7#171
MTEB multilingual v2 · Reranking · multilingual (22 languages)38.5#146

FAQ

How much does Potion Base 4M cost?›

There is no per-unit API price: self-host only.

Is Potion Base 4M free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Potion Base 4M, and what is it best at?›

#165 of 200 in Embeddings.

Is Potion Base 4M better than Potion Base 8M?›

On MTEB Indic v1 · Retrieval · multilingual (14 languages), Potion Base 4M scores 15.9 vs 16.2 — about the same.

When was Potion Base 4M released? Is there a newer version?›

Released 2024-10-29. It is the current version in its line.

Is Potion Base 4M open source?›

Yes, the weights are open (MIT licence).

Can I run Potion Base 4M locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Potion Base 4M?›

Potion Base 4M is an open-weights embeddings & retrieval model from minishlab, released Oct 2024.

What are the best alternatives to Potion Base 4M?›

E5 Base v2 (better), Qwen Indic v1 (open weights).