M

Ivysaur

Apr 2024
MIvysaur
Compare in
on
self-host onlyprice
45.8MTEB English v2
Apr 2024released
384Dimensions
1K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 14B672F2LLM v2 8B66.83F2LLM v2 4B66.14F2LLM v2 1.7B65.15Jina Embeddings v5 Text Nano64.8
···
58Gte Small40.159Ivysaur4060Snowflake Arctic Embed S39.7

Strong at

C
Embeddings & Retrieval#127 of 200

Alternatives?

ModelScoreCostPriceWhat changes
iBetterE5 Base v2unstatedOpen+6%—$0.005Memory (4-bit): 0 GB → 0.1 GBcOpenF2LLM v2 8Bunstated+67%——Memory (4-bit): 0 GB → 4.5 GBiBetterMultilingual E5 Large InstructunstatedOpen+43%—$0.01Memory (4-bit): 0 GB → 0.3 GBiBetterMultilingual E5 LargeunstatedOpen+37%—$0.01Memory (4-bit): 0 GB → 0.3 GBiBetterE5 Large v2unstatedOpen+14%—$0.01Memory (4-bit): 0 GB → 0.2 GB

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English44#135
BEIR · Mean over task types · English44#135
BEIR · Retrieval · English44#135
MTEB Persian v2 · Reranking · Persian30.9#104
JMTEB v2 · Clustering · Japanese15.1#116
JMTEB v2 · STS · Japanese63.8#86
LongEmbed · Mean over tasks · English36#99
LongEmbed · Mean over task types · English36#99
LongEmbed · Retrieval · English36#99
MTEB German v1 · Mean over tasks · German40#59
MTEB German v1 · Mean over task types · German38.1#63
MTEB German v1 · Clustering · German21.3#108
MTEB German v1 · Retrieval · German33.7#73
MTEB German v1 · Classification · German53#77
MTEB German v1 · STS · German52.3#71
MTEB German v1 · Pair Classification · German49.3#110
MTEB German v1 · Reranking · German19.3#108
MTEB Europe v1 · Retrieval · multilingual (25 languages)37.3#94
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)31.3#143
MTEB Europe v1 · Classification · multilingual (23 languages)51.2#67
MTEB Europe v1 · Clustering · multilingual (29 languages)33.2#128
MTEB Europe v1 · Instruction Reranking · English-2.2#132
MTEB Europe v1 · Pair Classification · multilingual (11 languages)82.9#91
MTEB Europe v1 · Reranking · multilingual (12 languages)49.2#115
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)11#120
MTEB French v1 · Mean over tasks · multilingual (2 languages)47.3#63
MTEB French v1 · Mean over task types · multilingual (2 languages)49.2#62
MTEB French v1 · STS · French70.7#56
MTEB French v1 · Retrieval · multilingual (2 languages)34.5#81
MTEB French v1 · Reranking · French63.7#93
MTEB French v1 · Clustering · French36.2#85
MTEB French v1 · Classification · French55.6#67
MTEB French v1 · Summarization · French29.1#119
MTEB French v1 · Pair Classification · French54.6#149
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)32.9#86
MTEB Indic v1 · Mean over task types · multilingual (25 languages)23.5#86
MTEB Indic v1 · Classification · multilingual (8 languages)43.3#93
MTEB Indic v1 · Retrieval · multilingual (14 languages)13.3#104
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)3.1#119
MTEB Indic v1 · Reranking · multilingual (2 languages)48.4#131
MTEB Indic v1 · Pair Classification · Hindi53.9#126
MTEB Indic v1 · STS · multilingual (13 languages)0.3#164
MTEB Indic v1 · Clustering · multilingual (21 languages)2.7#176
MTEB Korean v2 · Reranking · Korean10.4#101
MTEB Korean v2 · Classification · Korean21.6#106
MTEB Dutch v1 · Reranking · Dutch79.6#121
MTEB Polish v1 · Pair Classification · Polish65.7#85
MTEB Polish v1 · Classification · Polish43.9#71
MTEB Polish v1 · STS · Polish58.3#58
MTEB Portuguese v1 · Multilabel Classification · Portuguese20.3#70
MTEB Law v1 · Mean over tasks · multilingual (3 languages)40.2#82
MTEB Law v1 · Mean over task types · multilingual (3 languages)40.2#82
MTEB Law v1 · Retrieval · multilingual (3 languages)40.2#82
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)35.8#86
MTEB Medical v1 · Mean over task types · multilingual (10 languages)31#87
MTEB Medical v1 · Retrieval · multilingual (10 languages)37.6#87
MTEB Medical v1 · Clustering · English35.2#125
MTEB Medical v1 · Reranking · Mandarin Chinese20.1#138
FollowIR · Mean over tasks · English-2.2#132
FollowIR · Mean over task types · English-2.2#132
FollowIR · Instruction Reranking · English-2.2#132
MTEB Spanish v1 · Pair Classification · Spanish56.9#141
MTEB Spanish v1 · Clustering · Spanish39.2#89
MTEB Spanish v1 · Reranking · Spanish28.6#98
MTEB Thai v1 · Clustering · Thai3.5#158
MTEB Thai v1 · Pair Classification · Thai51#174
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)28.1#128
MTEB Scandinavian v1 · Classification · multilingual (6 languages)47.9#113
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)62.4#116
MTEB Russian v1.1 · Mean over tasks · Russian25.7#81
MTEB Russian v1.1 · Mean over task types · Russian26.2#81
MTEB Russian v1.1 · Classification · Russian29.2#118
MTEB Russian v1.1 · STS · Russian41.9#98
MTEB Russian v1.1 · Reranking · Russian21.7#111
MTEB Russian v1.1 · Clustering · Russian15.4#127
MTEB Russian v1.1 · Pair Classification · Russian44.1#196
MTEB Russian v1.1 · Retrieval · Russian5.6#76
MTEB Russian v1.1 · Multilabel Classification · Russian25.5#136
RTEB French beta · Mean over tasks · multilingual (2 languages)13.7#153
RTEB German beta · Mean over tasks · German16#142
RTEB Law beta · Mean over tasks · multilingual (4 languages)33#118
MTEB multilingual v2 · Classification · multilingual (119 languages)48.4#98
MTEB multilingual v2 · Clustering · multilingual (208 languages)37.6#122
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)71.5#136
MTEB multilingual v2 · Retrieval · multilingual (120 languages)34.4#131
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)22.9#135
MTEB multilingual v2 · Instruction Reranking · English-2.2#132
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)15.6#126
MTEB multilingual v2 · Reranking · multilingual (22 languages)44.1#120

FAQ

How much does Ivysaur cost?›

There is no per-unit API price: self-host only.

Is Ivysaur free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Ivysaur, and what is it best at?›

#127 of 200 in Embeddings.

Is Ivysaur better than Gte Small?›

On MTEB German v1 · Mean over tasks · German, Ivysaur scores 40 vs 40.1 — about the same.

When was Ivysaur released? Is there a newer version?›

Released 2024-04-27. It is the current version in its line.

Is Ivysaur open source?›

Yes, the weights are open (MIT licence).

Can I run Ivysaur locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Ivysaur?›

Ivysaur is an open-weights embeddings & retrieval model from Mihaiii, released Apr 2024.

What are the best alternatives to Ivysaur?›

E5 Base v2 (better), F2LLM v2 8B (open weights).