M

Squirtle

Apr 2024
MSquirtle
Compare in
on
self-host onlyprice
24MTEB English v2
Apr 2024released
384Dimensions
1K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B672F2LLM v2 8B66.83F2LLM v2 4B66.14F2LLM v2 1.7B65.15Jina Embeddings v5 Text Nano64.8
···
82LaBSE En Ru34.783Squirtle34.384Ru En RoSBERTa32

Strong at

C
Embeddings & Retrieval#180 of 200

Alternatives?

ModelScoreCostPriceWhat changes
iBetterE5 Base v2unstatedOpen+24%—$0.005Memory (4-bit): 0 GB → 0.1 GBcOpenF2LLM v2 8Bunstated+95%——Memory (4-bit): 0 GB → 4.5 GBtBetterGte BaseunstatedOpen+19%—$0.005Memory (4-bit): 0 GB → 0.1 GBBetterBge Base En v1.5unstatedOpen+18%—$0.005Memory (4-bit): 0 GB → 0.1 GBsBetterAll Mpnet Base v2unstatedOpen+13%—$0.005Max input: 1K tokens → 0K tokens+1

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English26.2#172
BEIR · Mean over task types · English26.2#172
BEIR · Retrieval · English26.2#172
MTEB Persian v2 · Reranking · Persian31.7#101
JMTEB v2 · Clustering · Japanese12.7#127
JMTEB v2 · STS · Japanese57.1#115
LongEmbed · Mean over tasks · English26.2#139
LongEmbed · Mean over task types · English26.2#139
LongEmbed · Retrieval · English26.2#139
MTEB German v1 · Mean over tasks · German34.3#83
MTEB German v1 · Mean over task types · German32.9#83
MTEB German v1 · Clustering · German16.1#123
MTEB German v1 · Retrieval · German22.2#93
MTEB German v1 · Classification · German49.2#97
MTEB German v1 · STS · German46.1#98
MTEB German v1 · Pair Classification · German48.2#156
MTEB German v1 · Reranking · German15.8#120
MTEB Europe v1 · Retrieval · multilingual (25 languages)27.2#118
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)23.9#159
MTEB Europe v1 · Classification · multilingual (23 languages)48.7#103
MTEB Europe v1 · Clustering · multilingual (29 languages)28.2#143
MTEB Europe v1 · Instruction Reranking · English-1.7#112
MTEB Europe v1 · Pair Classification · multilingual (11 languages)78.4#122
MTEB Europe v1 · Reranking · multilingual (12 languages)41.4#149
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)8.5#136
MTEB French v1 · Mean over tasks · multilingual (2 languages)40.8#83
MTEB French v1 · Mean over task types · multilingual (2 languages)43.4#82
MTEB French v1 · STS · French64.5#81
MTEB French v1 · Retrieval · multilingual (2 languages)23.6#106
MTEB French v1 · Reranking · French51.1#108
MTEB French v1 · Clustering · French32.2#98
MTEB French v1 · Classification · French49.5#104
MTEB French v1 · Summarization · French31.2#27
MTEB French v1 · Pair Classification · French51.7#174
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)32.1#94
MTEB Indic v1 · Mean over task types · multilingual (25 languages)22.8#95
MTEB Indic v1 · Classification · multilingual (8 languages)42.5#102
MTEB Indic v1 · Retrieval · multilingual (14 languages)13.1#107
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)2.1#146
MTEB Indic v1 · Reranking · multilingual (2 languages)48.4#130
MTEB Indic v1 · Pair Classification · Hindi52.2#155
MTEB Indic v1 · STS · multilingual (13 languages)-1.2#173
MTEB Indic v1 · Clustering · multilingual (21 languages)2.6#180
MTEB Korean v2 · Reranking · Korean11.5#96
MTEB Korean v2 · Classification · Korean22.7#87
MTEB Dutch v1 · Mean over tasks · Dutch32.2#112
MTEB Dutch v1 · Mean over task types · Dutch42.5#111
MTEB Dutch v1 · Classification · Dutch43.4#111
MTEB Dutch v1 · Clustering · Dutch14.2#114
MTEB Dutch v1 · Retrieval · Dutch22.5#110
MTEB Dutch v1 · STS · Dutch57.6#98
MTEB Dutch v1 · Multilabel Classification · Dutch23.3#115
MTEB Dutch v1 · Pair Classification · Dutch61.3#92
MTEB Dutch v1 · Reranking · Dutch75.2#156
MTEB Polish v1 · Pair Classification · Polish62.5#113
MTEB Polish v1 · Classification · Polish40.2#107
MTEB Polish v1 · STS · Polish53.6#86
MTEB Portuguese v1 · Multilabel Classification · Portuguese15.1#185
MTEB Law v1 · Mean over tasks · multilingual (3 languages)30.1#139
MTEB Law v1 · Mean over task types · multilingual (3 languages)30.1#139
MTEB Law v1 · Retrieval · multilingual (3 languages)30.1#139
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)23.7#114
MTEB Medical v1 · Mean over task types · multilingual (10 languages)23.6#110
MTEB Medical v1 · Retrieval · multilingual (10 languages)22.9#119
MTEB Medical v1 · Clustering · English29.9#199
MTEB Medical v1 · Reranking · Mandarin Chinese17.9#150
FollowIR · Mean over tasks · English-1.7#112
FollowIR · Mean over task types · English-1.7#112
FollowIR · Instruction Reranking · English-1.7#112
MTEB Spanish v1 · Pair Classification · Spanish57#140
MTEB Spanish v1 · Clustering · Spanish33.7#112
MTEB Spanish v1 · Reranking · Spanish19.8#123
MTEB Thai v1 · Clustering · Thai3#181
MTEB Thai v1 · Pair Classification · Thai51.1#161
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)25.4#137
MTEB Scandinavian v1 · Classification · multilingual (6 languages)47.8#115
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)61.9#125
MTEB Russian v1.1 · Mean over tasks · Russian23.2#89
MTEB Russian v1.1 · Mean over task types · Russian24#86
MTEB Russian v1.1 · Classification · Russian27.1#133
MTEB Russian v1.1 · STS · Russian38.8#107
MTEB Russian v1.1 · Reranking · Russian17.1#128
MTEB Russian v1.1 · Clustering · Russian12.8#149
MTEB Russian v1.1 · Pair Classification · Russian45.5#183
MTEB Russian v1.1 · Retrieval · Russian0.8#99
MTEB Russian v1.1 · Multilabel Classification · Russian26#119
RTEB French beta · Mean over tasks · multilingual (2 languages)4.1#183
RTEB German beta · Mean over tasks · German13.4#159
RTEB Law beta · Mean over tasks · multilingual (4 languages)26#171
MTEB multilingual v2 · Classification · multilingual (119 languages)45.9#129
MTEB multilingual v2 · Clustering · multilingual (208 languages)33.7#135
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)70.5#158
MTEB multilingual v2 · Retrieval · multilingual (120 languages)24.8#155
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)18.1#159
MTEB multilingual v2 · Instruction Reranking · English-1.7#112
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)13.8#152
MTEB multilingual v2 · Reranking · multilingual (22 languages)39.2#142

FAQ

How much does Squirtle cost?›

There is no per-unit API price: self-host only.

Is Squirtle free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Squirtle, and what is it best at?›

#180 of 200 in Embeddings.

Is Squirtle better than LaBSE En Ru?›

On MTEB German v1 · Mean over tasks · German, Squirtle scores 34.3 vs 34.7 — about the same.

When was Squirtle released? Is there a newer version?›

Released 2024-04-30. It is the current version in its line.

Is Squirtle open source?›

Yes, the weights are open (MIT licence).

Can I run Squirtle locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Squirtle?›

Squirtle is an open-weights embeddings & retrieval model from Mihaiii, released Apr 2024.

What are the best alternatives to Squirtle?›

E5 Base v2 (better), F2LLM v2 8B (open weights).