M

LLM2Vec Mistral 7B Instruct v2 Mntp Supervised

Apr 2024
MLLM2Vec Mistral 7B Instruct v2 Mntp Supervised
Compare in
on
self-host onlyprice
51.3MTEB English v2
Apr 2024released
33K tokensMax input
enLanguages

Rankingconfiguration unstated?

Full ranking →
1Yuan Embedding 2.0 En70.72Ingot 8B R3703Qwen 3 Embedding 8B69.44Geevec Embeddings 1.068.85Qwen 3 Embedding 4B68.5
···
104EmbeddingGemma 251.3105LLM2Vec Mistral 7B Instruct v2 Mntp Supervised51.3106E5 Omni 3B51.2

Strong at

B
Embeddings & Retrieval#98 of 200

Alternatives?

ModelScoreCostPriceWhat changes
BetterEmbeddingGemma 300MunstatedOpen+9%—$0.002Max input: 33K tokens → 2K tokens+1IOpenYuan Embedding 2.0 Enunstated+38%——BetterBge Base En v1.5unstatedOpen+7%—$0.005Max input: 33K tokens → 1K tokensBetterQwen 3 Embedding 8BunstatedOpen+35%—$0.01Languages: not verified+1BetterQwen 3 Embedding 0.6BunstatedOpen+21%—$0.01Languages: not verified

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English56#33
BEIR · Mean over task types · English56#33
BEIR · Retrieval · English56#33
MTEB Persian v2 · Reranking · Persian56.3#53
JMTEB v2 · Clustering · Japanese40.4#64
LongEmbed · Mean over tasks · English34.5#104
LongEmbed · Mean over task types · English34.5#104
LongEmbed · Retrieval · English34.5#104
MTEB German v1 · Clustering · German31#42
MTEB German v1 · Classification · German70.8#22
MTEB German v1 · STS · German57.8#53
MTEB German v1 · Pair Classification · German54#32
MTEB German v1 · Reranking · German45.7#43
MTEB Europe v1 · Retrieval · multilingual (25 languages)44.7#52
MTEB Europe v1 · Classification · multilingual (23 languages)59.3#25
MTEB Europe v1 · Clustering · multilingual (29 languages)37.2#82
MTEB Europe v1 · Instruction Reranking · English-0.9#83
MTEB Europe v1 · Pair Classification · multilingual (11 languages)87#42
MTEB Europe v1 · Reranking · multilingual (12 languages)53#80
MTEB French v1 · Mean over tasks · multilingual (2 languages)54.4#27
MTEB French v1 · Mean over task types · multilingual (2 languages)55.5#26
MTEB French v1 · STS · French72#50
MTEB French v1 · Retrieval · multilingual (2 languages)39.3#61
MTEB French v1 · Reranking · French72.4#51
MTEB French v1 · Clustering · French40.7#61
MTEB French v1 · Classification · French70.6#19
MTEB French v1 · Summarization · French28.3#135
MTEB French v1 · Pair Classification · French65.1#31
MTEB Indic v1 · Classification · multilingual (8 languages)54.4#55
MTEB Indic v1 · Retrieval · multilingual (14 languages)50.9#60
MTEB Indic v1 · Reranking · multilingual (2 languages)69.3#96
MTEB Indic v1 · Pair Classification · Hindi57.6#103
MTEB Indic v1 · STS · multilingual (13 languages)12#94
MTEB Indic v1 · Clustering · multilingual (21 languages)10.9#100
MTEB Korean v2 · Reranking · Korean47.7#48
MTEB Dutch v1 · Reranking · Dutch86.4#77
MTEB Polish v1 · Pair Classification · Polish75.5#68
MTEB Polish v1 · Classification · Polish60#32
MTEB Polish v1 · STS · Polish60.9#50
MTEB Law v1 · Mean over tasks · multilingual (3 languages)36.5#110
MTEB Law v1 · Mean over task types · multilingual (3 languages)36.5#110
MTEB Law v1 · Retrieval · multilingual (3 languages)36.5#110
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)48.3#42
MTEB Medical v1 · Mean over task types · multilingual (10 languages)49.4#42
MTEB Medical v1 · Retrieval · multilingual (10 languages)49.7#44
MTEB Medical v1 · Clustering · English33.8#147
MTEB Medical v1 · Reranking · Mandarin Chinese64.7#85
FollowIR · Mean over tasks · English-0.9#83
FollowIR · Mean over task types · English-0.9#83
FollowIR · Instruction Reranking · English-0.9#83
MTEB Spanish v1 · Pair Classification · Spanish65.3#61
MTEB Spanish v1 · Clustering · Spanish42.9#55
MTEB Spanish v1 · Reranking · Spanish52.3#47
MTEB Thai v1 · Clustering · Thai25.3#101
MTEB Thai v1 · Pair Classification · Thai58#101
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)41.1#39
MTEB Russian v1.1 · Classification · Russian60.8#43
MTEB Russian v1.1 · STS · Russian62.2#69
MTEB Russian v1.1 · Reranking · Russian56.5#55
MTEB Russian v1.1 · Clustering · Russian52.9#53
MTEB Russian v1.1 · Pair Classification · Russian55.1#90
MTEB Russian v1.1 · Multilabel Classification · Russian31.9#65
RTEB French beta · Mean over tasks · multilingual (2 languages)15.2#149
RTEB German beta · Mean over tasks · German21.5#119
RTEB Law beta · Mean over tasks · multilingual (4 languages)34.4#106
MTEB multilingual v2 · Classification · multilingual (119 languages)57.2#56
MTEB multilingual v2 · Clustering · multilingual (208 languages)41.3#80
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)76.8#67
MTEB multilingual v2 · Retrieval · multilingual (120 languages)43.1#83
MTEB multilingual v2 · Instruction Reranking · English-0.9#83
MTEB multilingual v2 · Reranking · multilingual (22 languages)55.5#77

FAQ

How much does LLM2Vec Mistral 7B Instruct v2 Mntp Supervised cost?›

There is no per-unit API price: self-host only.

Is LLM2Vec Mistral 7B Instruct v2 Mntp Supervised free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is LLM2Vec Mistral 7B Instruct v2 Mntp Supervised, and what is it best at?›

#98 of 200 in Embeddings.

Is LLM2Vec Mistral 7B Instruct v2 Mntp Supervised better than EmbeddingGemma 2?›

On MTEB English v2 · Retrieval · English, LLM2Vec Mistral 7B Instruct v2 Mntp Supervised scores 51.3 vs 51.3 — about the same.

When was LLM2Vec Mistral 7B Instruct v2 Mntp Supervised released? Is there a newer version?›

Released 2024-04-09. It is the current version in its line.

Is LLM2Vec Mistral 7B Instruct v2 Mntp Supervised open source?›

Yes, the weights are open (MIT licence).

Can I run LLM2Vec Mistral 7B Instruct v2 Mntp Supervised locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is LLM2Vec Mistral 7B Instruct v2 Mntp Supervised?›

LLM2Vec Mistral 7B Instruct v2 Mntp Supervised is an open-weights embeddings & retrieval model from McGill-NLP, released Apr 2024.

What are the best alternatives to LLM2Vec Mistral 7B Instruct v2 Mntp Supervised?›

EmbeddingGemma 300M (better), Yuan Embedding 2.0 En (open weights).