LLM2Vec Sheared Llama Mntp Supervised measured on 6 of 261 Embeddings benchmarks6
BenchmarkByScoreRank
No benchmark matches
self-host onlyprice
86.2MTEB English v2
Apr 2024released
33K tokensMax input
enLanguages
Alternatives?
ModelScoreCostPriceWhat changes
BetterQwen 3 Embedding 8BunstatedOpen+22%—$0.01Languages: not verified+1
OpenNV Embed v2unstated+23%——Memory (4-bit): 0.8 GB → 4.7 GB
BetterBge En IclunstatedOpen+21%—$0.01Languages: not verified+1BetterQwen 3 Embedding 0.6BunstatedOpen+8%—$0.01Languages: not verifiedBetterBge Large En v1.5unstatedOpen+6%—$0.01Max input: 33K tokens → 1K tokensModelScoreCostPriceWhat changes
Nothing here yet.
ModelScoreCostPriceWhat changes
Qwen 3 Embedding 8BunstatedOpen+22%—$0.01Languages: not verified+1Bge En IclunstatedOpen+21%—$0.01Languages: not verified+1Qwen 3 Embedding 0.6BunstatedOpen+8%—$0.01Languages: not verifiedBge Large En v1.5unstatedOpen+6%—$0.01Max input: 33K tokens → 1K tokensQwen 3 Embedding 4BunstatedOpen+20%—$0.02Languages: not verified+1ModelScoreCostPriceWhat changes
NV Embed v2unstatedOpen+23%——Memory (4-bit): 0.8 GB → 4.7 GBQwen 3 Embedding 8BunstatedOpen+22%—$0.01Languages: not verified+1Bge En IclunstatedOpen+21%—$0.01Languages: not verified+1yLENS D8000unstatedOpen+20%——Languages: not verified+1iInf Retriever v1unstatedOpen+20%——Memory (4-bit): 0.8 GB → 4.2 GBModelScoreCostPriceWhat changes
MLLM2Vec Meta Llama 3 8B Instruct Mntp SupervisedunstatedOpen+10%——Max input: 33K tokens → 8K tokens+1MLLM2Vec Mistral 7B Instruct v2 Mntp SupervisedunstatedOpen+9%——Memory (4-bit): 0.8 GB → 4.3 GBMLLM2Vec Llama 2 7B Chat Hf Mntp SupervisedunstatedOpen+6%——Memory (4-bit): 0.8 GB → 4 GBMLLM2Vec Meta Llama 3 8B Instruct Mntp Unsup SimcseunstatedOpen-24%——Max input: 33K tokens → 8K tokens+1MLLM2Vec Mistral 7B Instruct v2 Mntp Unsup SimcseunstatedOpen-26%——Memory (4-bit): 0.8 GB → 4.3 GBMLLM2Vec Llama 2 7B Chat Hf Mntp Unsup SimcseunstatedOpen-29%——Memory (4-bit): 0.8 GB → 4 GBMLLM2Vec Sheared Llama Mntp Unsup SimcseunstatedOpen-50%——All McGill-NLP models →Run it yourself
estimateFits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use
Benchmarks
in Embeddings & RetrievalBEIR · Retrieval · English51.4#86
FAQ
How much does LLM2Vec Sheared Llama Mntp Supervised cost?›
There is no per-unit API price: self-host only.
Is LLM2Vec Sheared Llama Mntp Supervised free to use?›
There is no free API. The weights are open, so you can run it yourself.
How good is LLM2Vec Sheared Llama Mntp Supervised, and what is it best at?›
#50 of 238 in Embeddings.
Is LLM2Vec Sheared Llama Mntp Supervised better than Multilingual E5 Large?›
On BEIR · Mean over task types · English, LLM2Vec Sheared Llama Mntp Supervised scores 51.4 vs 51.5 — about the same.
When was LLM2Vec Sheared Llama Mntp Supervised released? Is there a newer version?›
Released 2024-04-09. It is the current version in its line.
Is LLM2Vec Sheared Llama Mntp Supervised open source?›
Yes, the weights are open (MIT licence).
Can I run LLM2Vec Sheared Llama Mntp Supervised locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
What is LLM2Vec Sheared Llama Mntp Supervised?›
LLM2Vec Sheared Llama Mntp Supervised is an open-weights embeddings & retrieval model from McGill-NLP, released Apr 2024.
What are the best alternatives to LLM2Vec Sheared Llama Mntp Supervised?›
Qwen 3 Embedding 8B (better), NV Embed v2 (open weights).