M

Squirtle

Apr 2024
MSquirtle
Compare in
on
self-host onlyprice
24MTEB English v2
Apr 2024released
384Dimensions
1K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1Multilingual E5 Base332Rubert Tiny232.53Sentence Croissant Alpha v0.332.54Speed Embedding 7B Instruct32.45Bilingual Embedding Small32.3
···
27Cohere Embed Multilingual v3.031.228Squirtle31.229Mmlw E5 Large31.2

Strong at

C
Embeddings & Retrieval#180 of 200

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English26.2#174
BEIR · Mean over task types · English26.2#174
BEIR · Retrieval · English26.2#174
MTEB Persian v2 · Reranking · Persian31.7#101
JMTEB v2 · Clustering · Japanese12.7#133
JMTEB v2 · STS · Japanese57.1#121
LongEmbed · Mean over tasks · English26.2#139
LongEmbed · Mean over task types · English26.2#139
LongEmbed · Retrieval · English26.2#139
MTEB German v1 · Mean over tasks · German34.3#92
MTEB German v1 · Mean over task types · German32.9#92
MTEB German v1 · Classification · German49.2#100
MTEB German v1 · Pair Classification · German48.2#163
MTEB German v1 · STS · German46.1#107
MTEB German v1 · Clustering · German16.1#126
MTEB German v1 · Retrieval · German22.2#105
MTEB German v1 · Reranking · German15.8#120
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)40.3#58
MTEB Europe v1 · Mean over task types · multilingual (29 languages)35.2#58
MTEB Europe v1 · Classification · multilingual (23 languages)48.7#106
MTEB Europe v1 · Instruction Reranking · English-1.7#113
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)8.5#136
MTEB Europe v1 · STS · multilingual (8 languages)62.4#79
MTEB Europe v1 · Pair Classification · multilingual (11 languages)78.4#137
MTEB Europe v1 · Clustering · multilingual (29 languages)28.2#144
MTEB Europe v1 · Retrieval · multilingual (25 languages)27.2#131
MTEB Europe v1 · Reranking · multilingual (12 languages)41.4#150
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)23.9#160
MTEB French v1 · Mean over tasks · multilingual (2 languages)40.8#83
MTEB French v1 · Mean over task types · multilingual (2 languages)43.4#82
MTEB French v1 · STS · French64.5#86
MTEB French v1 · Retrieval · multilingual (2 languages)23.6#111
MTEB French v1 · Classification · French49.5#107
MTEB French v1 · Clustering · French32.2#99
MTEB French v1 · Reranking · French51.1#116
MTEB French v1 · Pair Classification · French51.7#174
MTEB French v1 · Summarization · French31.2#28
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)32.1#98
MTEB Indic v1 · Mean over task types · multilingual (25 languages)22.8#99
MTEB Indic v1 · Classification · multilingual (8 languages)42.5#109
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)2.1#151
MTEB Indic v1 · STS · multilingual (13 languages)-1.2#174
MTEB Indic v1 · Reranking · multilingual (2 languages)48.4#131
MTEB Indic v1 · Retrieval · multilingual (14 languages)13.1#113
MTEB Indic v1 · Pair Classification · Hindi52.2#156
MTEB Indic v1 · Clustering · multilingual (21 languages)2.6#181
MTEB Korean v2 · STS · Korean42.8#64
MTEB Korean v2 · Classification · Korean22.7#97
MTEB Korean v2 · Reranking · Korean11.5#100
MTEB Dutch v1 · Mean over tasks · Dutch32.2#112
MTEB Dutch v1 · Mean over task types · Dutch42.5#111
MTEB Dutch v1 · Retrieval · Dutch22.5#110
MTEB Dutch v1 · Classification · Dutch43.4#111
MTEB Dutch v1 · Multilabel Classification · Dutch23.3#116
MTEB Dutch v1 · STS · Dutch57.6#98
MTEB Dutch v1 · Clustering · Dutch14.2#115
MTEB Dutch v1 · Reranking · Dutch75.2#157
MTEB Dutch v1 · Pair Classification · Dutch61.3#93
MTEB Polish v1 · Mean over tasks · Polish44.2#82
MTEB Polish v1 · Mean over task types · Polish44#81
MTEB Polish v1 · Classification · Polish40.2#115
MTEB Polish v1 · Clustering · Polish19.8#111
MTEB Polish v1 · STS · Polish53.6#91
MTEB Polish v1 · Pair Classification · Polish62.5#121
MTEB Portuguese v1 · Multilabel Classification · Portuguese15.1#187
MTEB Law v1 · Mean over tasks · multilingual (3 languages)30.1#143
MTEB Law v1 · Mean over task types · multilingual (3 languages)30.1#143
MTEB Law v1 · Retrieval · multilingual (3 languages)30.1#143
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)23.7#117
MTEB Medical v1 · Mean over task types · multilingual (10 languages)23.6#113
MTEB Medical v1 · Retrieval · multilingual (10 languages)22.9#122
MTEB Medical v1 · Clustering · English29.9#199
MTEB Medical v1 · Reranking · Mandarin Chinese17.9#155
FollowIR · Mean over tasks · English-1.7#113
FollowIR · Mean over task types · English-1.7#113
FollowIR · Instruction Reranking · English-1.7#113
MTEB Spanish v1 · STS · multilingual (2 languages)59.2#69
MTEB Spanish v1 · Clustering · Spanish33.7#112
MTEB Spanish v1 · Pair Classification · Spanish57#140
MTEB Spanish v1 · Reranking · Spanish19.8#123
MTEB Spanish v1 · Classification · Spanish65.4#85
MTEB Thai v1 · Pair Classification · Thai51.1#162
MTEB Thai v1 · Clustering · Thai3#182
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)39.4#104
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)41.1#101
MTEB Scandinavian v1 · Classification · multilingual (6 languages)47.8#120
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)29.5#110
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)25.4#144
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)61.9#125
MTEB Russian v1.1 · Mean over tasks · Russian23.2#89
MTEB Russian v1.1 · Mean over task types · Russian24#86
MTEB Russian v1.1 · Classification · Russian27.1#136
MTEB Russian v1.1 · Clustering · Russian12.8#154
MTEB Russian v1.1 · Reranking · Russian17.1#128
MTEB Russian v1.1 · Multilabel Classification · Russian26#124
MTEB Russian v1.1 · STS · Russian38.8#109
MTEB Russian v1.1 · Retrieval · Russian0.8#99
MTEB Russian v1.1 · Pair Classification · Russian45.5#184
RTEB French beta · Mean over tasks · multilingual (2 languages)4.1#186
RTEB German beta · Mean over tasks · German13.4#167
RTEB Law beta · Mean over tasks · multilingual (4 languages)26#178
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)39.3#85
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)33.3#83
MTEB multilingual v2 · Clustering · multilingual (208 languages)33.7#136
MTEB multilingual v2 · STS · multilingual (35 languages)55#97
MTEB multilingual v2 · Classification · multilingual (119 languages)45.9#130
MTEB multilingual v2 · Retrieval · multilingual (120 languages)24.8#157
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)13.8#153
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)18.1#160
MTEB multilingual v2 · Instruction Reranking · English-1.7#113
MTEB multilingual v2 · Reranking · multilingual (22 languages)39.2#143
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)70.5#159

FAQ

How much does Squirtle cost?›

There is no per-unit API price: self-host only.

Is Squirtle free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Squirtle, and what is it best at?›

#180 of 200 in Embeddings.

Is Squirtle better than Cohere Embed Multilingual v3.0?›

On MTEB French v1 · Summarization · French, Squirtle scores 31.2 vs 31.2 — about the same.

When was Squirtle released? Is there a newer version?›

Released 2024-04-30. It is the current version in its line.

Is Squirtle open source?›

Yes, the weights are open (MIT licence).

Can I run Squirtle locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Squirtle?›

Squirtle is an open-weights embeddings & retrieval model from Mihaiii, released Apr 2024.

What are the best alternatives to Squirtle?›

Multilingual E5 Base (open weights).