LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse measured on 6 of 261 Embeddings benchmarks6
BenchmarkByScoreRank
No benchmark matches
self-host onlyprice
78MTEB English v2
Apr 2024released
8K tokensMax input
enLanguages
Alternatives?
ModelScoreCostPriceWhat changes
BetterBge Base En v1.5unstatedOpen+36%—$0.005Max input: 8K tokens → 1K tokens
OpenNV Embed v2unstated+61%——Memory (4-bit): 4.5 GB → 4.7 GBtBetterGte BaseunstatedOpen+31%—$0.005Max input: 8K tokens → 1K tokensiBetterE5 Base v2unstatedOpen+28%—$0.005Max input: 8K tokens → 1K tokenssBetterAll Mpnet Base v2unstatedOpen+12%—$0.005Max input: 8K tokens → 0K tokensModelScoreCostPriceWhat changes
Nothing here yet.
ModelScoreCostPriceWhat changes
Bge Base En v1.5unstatedOpen+36%—$0.005Max input: 8K tokens → 1K tokenstGte BaseunstatedOpen+31%—$0.005Max input: 8K tokens → 1K tokensiE5 Base v2unstatedOpen+28%—$0.005Max input: 8K tokens → 1K tokenssAll Mpnet Base v2unstatedOpen+12%—$0.005Max input: 8K tokens → 0K tokenssAll MiniLM L12 v2unstatedOpen+9%—$0.005Max input: 8K tokens → 0K tokensModelScoreCostPriceWhat changes
NV Embed v2unstatedOpen+61%——Memory (4-bit): 4.5 GB → 4.7 GB
Qwen 3 Embedding 8BunstatedOpen+60%—$0.01Languages: not verifiedBge En IclunstatedOpen+59%—$0.01Languages: not verifiedyLENS D8000unstatedOpen+58%——Languages: not verifiediInf Retriever v1unstatedOpen+57%——ModelScoreCostPriceWhat changes
MLLM2Vec Meta Llama 3 8B Instruct Mntp SupervisedunstatedOpen+45%——MLLM2Vec Mistral 7B Instruct v2 Mntp SupervisedunstatedOpen+43%——MLLM2Vec Llama 2 7B Chat Hf Mntp SupervisedunstatedOpen+39%——MLLM2Vec Sheared Llama Mntp SupervisedunstatedOpen+31%——MLLM2Vec Mistral 7B Instruct v2 Mntp Unsup SimcseunstatedOpen-3%——MLLM2Vec Llama 2 7B Chat Hf Mntp Unsup SimcseunstatedOpen-6%——MLLM2Vec Sheared Llama Mntp Unsup SimcseunstatedOpen-34%——All McGill-NLP models →Run it yourself
estimateFits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use
Benchmarks
in Embeddings & RetrievalBEIR · Mean over tasks · English39.2#147
BEIR · Retrieval · English39.2#147
FAQ
How much does LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse cost?›
There is no per-unit API price: self-host only.
Is LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse free to use?›
There is no free API. The weights are open, so you can run it yourself.
How good is LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse, and what is it best at?›
#202 of 238 in Embeddings.
Is LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse better than Mmlw Roberta Base?›
On BEIR · Mean over task types · English, LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse scores 39.2 vs 39.2 — about the same.
When was LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse released? Is there a newer version?›
Released 2024-04-09. It is the current version in its line.
Is LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse open source?›
Yes, the weights are open (MIT licence).
Can I run LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
What is LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse?›
LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse is an open-weights embeddings & retrieval model from McGill-NLP, released Apr 2024.
What are the best alternatives to LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse?›
Bge Base En v1.5 (better), NV Embed v2 (open weights).