LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised measured on 6 of 261 Embeddings benchmarks6
BenchmarkByScoreRank
No benchmark matches
self-host onlyprice
87.8MTEB English v2
Apr 2024released
8K tokensMax input
enLanguages
Alternatives?
ModelScoreCostPriceWhat changes
BetterQwen 3 Embedding 8BunstatedOpen+11%—$0.01Languages: not verified
OpenNV Embed v2unstated+12%——Memory (4-bit): 4.5 GB → 4.7 GB
BetterBge En IclunstatedOpen+10%—$0.01Languages: not verifiedBetterQwen 3 Embedding 4BunstatedOpen+9%—$0.02Languages: not verifiedBetterBge Multilingual Gemma2unstatedOpen+5%—$0.11Languages: not verified+1ModelScoreCostPriceWhat changes
Nothing here yet.
ModelScoreCostPriceWhat changes
Qwen 3 Embedding 8BunstatedOpen+11%—$0.01Languages: not verifiedBge En IclunstatedOpen+10%—$0.01Languages: not verifiedQwen 3 Embedding 4BunstatedOpen+9%—$0.02Languages: not verifiedBge Multilingual Gemma2unstatedOpen+5%—$0.11Languages: not verified+1VVoyage 3 M Expunstated+20%——Languages: not verifiedModelScoreCostPriceWhat changes
NV Embed v2unstatedOpen+12%——Memory (4-bit): 4.5 GB → 4.7 GBQwen 3 Embedding 8BunstatedOpen+11%—$0.01Languages: not verifiedBge En IclunstatedOpen+10%—$0.01Languages: not verifiedyLENS D8000unstatedOpen+9%——Languages: not verifiediInf Retriever v1unstatedOpen+9%——ModelScoreCostPriceWhat changes
MLLM2Vec Mistral 7B Instruct v2 Mntp SupervisedunstatedOpensame——MLLM2Vec Llama 2 7B Chat Hf Mntp SupervisedunstatedOpen-4%——MLLM2Vec Sheared Llama Mntp SupervisedunstatedOpen-9%——MLLM2Vec Meta Llama 3 8B Instruct Mntp Unsup SimcseunstatedOpen-31%——MLLM2Vec Mistral 7B Instruct v2 Mntp Unsup SimcseunstatedOpen-33%——MLLM2Vec Llama 2 7B Chat Hf Mntp Unsup SimcseunstatedOpen-35%——MLLM2Vec Sheared Llama Mntp Unsup SimcseunstatedOpen-54%——All McGill-NLP models →Run it yourself
estimateFits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use
Benchmarks
in Embeddings & RetrievalBEIR · Retrieval · English56.6#30
FAQ
How much does LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised cost?›
There is no per-unit API price: self-host only.
Is LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised free to use?›
There is no free API. The weights are open, so you can run it yourself.
How good is LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised, and what is it best at?›
#22 of 238 in Embeddings.
Is LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised better than mDenseOn?›
On BEIR · Mean over tasks · English, LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised scores 56.6 vs 56.7 — about the same.
When was LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised released? Is there a newer version?›
Released 2024-04-09. It is the current version in its line.
Is LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised open source?›
Yes, the weights are open (MIT licence).
Can I run LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
What is LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised?›
LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised is an open-weights embeddings & retrieval model from McGill-NLP, released Apr 2024.
What are the best alternatives to LLM2Vec Meta Llama 3 8B Instruct Mntp Supervised?›
Qwen 3 Embedding 8B (better), NV Embed v2 (open weights).