M

LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse

Apr 2024
MLLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse
Compare in
on
self-host onlyprice
31MTEB English v2
Apr 2024released
33K tokensMax input
enLanguages

Rankingconfiguration unstated?

Full ranking →
1Giga Embeddings Instruct 3B 082668.32Giga Embeddings Instruct 10B A1.8B 0826683FRIDA67.54Giga Embeddings Instruct67.55Qwen 3 Embedding 8B66.7
···
88Distilrubert Small Cased Conversational38.489LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse3790Rubert Tiny30.8

Strong at

C
Embeddings & Retrieval#162 of 200

Alternatives?

ModelScoreCostPriceWhat changes
BetterEmbeddingGemma 300MunstatedOpen+61%—$0.002Max input: 33K tokens → 2K tokens+1aOpenGiga Embeddings Instruct 3B 0826unstated+84%——Max input: 33K tokens → 8K tokensBetterQwen 3 Embedding 8BunstatedOpen+80%—$0.01Languages: not verified+1iBetterMultilingual E5 Large InstructunstatedOpen+70%—$0.01Max input: 33K tokens → 1K tokensBetterQwen 3 Embedding 0.6BunstatedOpen+63%—$0.01Languages: not verified

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English38.1#151
BEIR · Mean over task types · English38.1#151
BEIR · Retrieval · English38.1#151
MTEB Persian v2 · Reranking · Persian47#62
JMTEB v2 · Clustering · Japanese23#82
LongEmbed · Mean over tasks · English29.8#127
LongEmbed · Mean over task types · English29.8#127
LongEmbed · Retrieval · English29.8#127
MTEB German v1 · Clustering · German24.5#88
MTEB German v1 · Classification · German63.1#52
MTEB German v1 · STS · German45.8#102
MTEB German v1 · Pair Classification · German53.9#34
MTEB German v1 · Reranking · German24#88
MTEB Europe v1 · Retrieval · multilingual (25 languages)32.3#109
MTEB Europe v1 · Classification · multilingual (23 languages)55.2#43
MTEB Europe v1 · Clustering · multilingual (29 languages)32#134
MTEB Europe v1 · Instruction Reranking · English-1.1#88
MTEB Europe v1 · Pair Classification · multilingual (11 languages)81.7#99
MTEB Europe v1 · Reranking · multilingual (12 languages)40.6#151
MTEB French v1 · Mean over tasks · multilingual (2 languages)43.7#76
MTEB French v1 · Mean over task types · multilingual (2 languages)45.9#76
MTEB French v1 · STS · French56.6#94
MTEB French v1 · Retrieval · multilingual (2 languages)19.5#112
MTEB French v1 · Reranking · French51.1#109
MTEB French v1 · Clustering · French35.8#86
MTEB French v1 · Classification · French62.6#48
MTEB French v1 · Summarization · French30.9#38
MTEB French v1 · Pair Classification · French64.6#35
MTEB Indic v1 · Classification · multilingual (8 languages)52.1#56
MTEB Indic v1 · Retrieval · multilingual (14 languages)40.7#65
MTEB Indic v1 · Reranking · multilingual (2 languages)64.9#98
MTEB Indic v1 · Pair Classification · Hindi53.5#135
MTEB Indic v1 · STS · multilingual (13 languages)8.3#108
MTEB Indic v1 · Clustering · multilingual (21 languages)5.3#108
MTEB Korean v2 · Reranking · Korean28.8#62
MTEB Dutch v1 · Reranking · Dutch75.6#152
MTEB Polish v1 · Pair Classification · Polish65.7#86
MTEB Polish v1 · Classification · Polish54#53
MTEB Polish v1 · STS · Polish49.9#102
MTEB Law v1 · Mean over tasks · multilingual (3 languages)27#144
MTEB Law v1 · Mean over task types · multilingual (3 languages)27#144
MTEB Law v1 · Retrieval · multilingual (3 languages)27#144
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)34.2#89
MTEB Medical v1 · Mean over task types · multilingual (10 languages)37.6#50
MTEB Medical v1 · Retrieval · multilingual (10 languages)33.3#93
MTEB Medical v1 · Clustering · English31.4#182
MTEB Medical v1 · Reranking · Mandarin Chinese48#99
FollowIR · Mean over tasks · English-1.1#88
FollowIR · Mean over task types · English-1.1#88
FollowIR · Instruction Reranking · English-1.1#88
MTEB Spanish v1 · Pair Classification · Spanish59.3#114
MTEB Spanish v1 · Clustering · Spanish43.6#51
MTEB Spanish v1 · Reranking · Spanish27.3#104
MTEB Thai v1 · Clustering · Thai9.3#109
MTEB Thai v1 · Pair Classification · Thai54.5#104
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)35.7#69
MTEB Russian v1.1 · Classification · Russian54#72
MTEB Russian v1.1 · STS · Russian48.6#81
MTEB Russian v1.1 · Reranking · Russian36.3#79
MTEB Russian v1.1 · Clustering · Russian37#89
MTEB Russian v1.1 · Pair Classification · Russian50.2#134
MTEB Russian v1.1 · Multilabel Classification · Russian27.8#88
RTEB French beta · Mean over tasks · multilingual (2 languages)3.5#186
RTEB German beta · Mean over tasks · German14.6#152
RTEB Law beta · Mean over tasks · multilingual (4 languages)24.6#179
MTEB multilingual v2 · Classification · multilingual (119 languages)54.7#65
MTEB multilingual v2 · Clustering · multilingual (208 languages)38.2#116
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)72.4#107
MTEB multilingual v2 · Retrieval · multilingual (120 languages)30.6#144
MTEB multilingual v2 · Instruction Reranking · English-1.1#88
MTEB multilingual v2 · Reranking · multilingual (22 languages)44.1#119

FAQ

How much does LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse cost?›

There is no per-unit API price: self-host only.

Is LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse, and what is it best at?›

#162 of 200 in Embeddings.

Is LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse better than Distilrubert Small Cased Conversational?›

On MTEB Russian v1.1 · Clustering · Russian, LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse scores 37 vs 38.4 — lower.

When was LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse released? Is there a newer version?›

Released 2024-04-09. It is the current version in its line.

Is LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse open source?›

Yes, the weights are open (MIT licence).

Can I run LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse?›

LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse is an open-weights embeddings & retrieval model from McGill-NLP, released Apr 2024.

What are the best alternatives to LLM2Vec Mistral 7B Instruct v2 Mntp Unsup Simcse?›

EmbeddingGemma 300M (better), Giga Embeddings Instruct 3B 0826 (open weights).