LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse measured on 6 of 194 Embeddings benchmarks6
BenchmarkByScoreRank
No benchmark matches
self-host onlyprice
78MTEB English v2
Apr 2024released
8K tokensMax input
enLanguages
Alternatives?
ModelScoreCostPriceWhat changes
BetterEmbeddingGemma 300MunstatedOpen+9%—$0.002Max input: 8K tokens → 2K tokens+1IOpenYuan Embedding 2.0 Enunstated+22%——sBetterAll Mpnet Base v2unstatedOpen+11%—$0.005Max input: 8K tokens → 0K tokenssBetterAll MiniLM L12 v2unstatedOpen+9%—$0.005Max input: 8K tokens → 0K tokenstBetterGte BaseunstatedOpen+8%—$0.005Max input: 8K tokens → 1K tokensModelScoreCostPriceWhat changes
Nothing here yet.
ModelScoreCostPriceWhat changes
EmbeddingGemma 300MunstatedOpen+9%—$0.002Max input: 8K tokens → 2K tokens+1sAll Mpnet Base v2unstatedOpen+11%—$0.005Max input: 8K tokens → 0K tokenssAll MiniLM L12 v2unstatedOpen+9%—$0.005Max input: 8K tokens → 0K tokenstGte BaseunstatedOpen+8%—$0.005Max input: 8K tokens → 1K tokenssAll MiniLM L6 v2unstatedOpen+8%—$0.005Max input: 8K tokens → 0K tokensModelScoreCostPriceWhat changes
IYuan Embedding 2.0 EnunstatedOpen+22%——KQZhou EmbeddingunstatedOpen+19%——
Qwen 3 Embedding 8BunstatedOpen+18%—$0.01Languages: not verifiedQwen 3 Embedding 4BunstatedOpen+16%—$0.02Languages: not verifiediJasper Token Compression 600MunstatedOpen+16%——ModelScoreCostPriceWhat changes
MLLM2Vec Meta Llama 3 8B Instruct Mntp SupervisedunstatedOpen+12%——MLLM2Vec Mistral 7B Instruct v2 Mntp SupervisedunstatedOpen+9%——MLLM2Vec Sheared Llama Mntp SupervisedunstatedOpen+6%——MLLM2Vec Mistral 7B Instruct v2 Mntp Unsup SimcseunstatedOpensame——MLLM2Vec Llama 2 7B Chat Hf Mntp Unsup SimcseunstatedOpensame——MLLM2Vec Sheared Llama Mntp Unsup SimcseunstatedOpen-6%——MLLM2Vec Llama 2 7B Chat Hf Mntp SupervisedunstatedOpenn/a——All McGill-NLP models →Run it yourself
estimateFits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use
Benchmarks
in Embeddings & RetrievalBEIR · Mean over tasks · English39.2#149
BEIR · Retrieval · English39.2#149
FAQ
How much does LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse cost?›
There is no per-unit API price: self-host only.
Is LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse free to use?›
There is no free API. The weights are open, so you can run it yourself.
How good is LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse, and what is it best at?›
#202 of 238 in Embeddings.
Is LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse better than Deepset Mxbai Embed De Large v1?›
On MTEB English v2 · Reranking · English, LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse scores 43.6 vs 43.7 — about the same.
When was LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse released? Is there a newer version?›
Released 2024-04-09. It is the current version in its line.
Is LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse open source?›
Yes, the weights are open (MIT licence).
Can I run LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
What is LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse?›
LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse is an open-weights embeddings & retrieval model from McGill-NLP, released Apr 2024.
What are the best alternatives to LLM2Vec Meta Llama 3 8B Instruct Mntp Unsup Simcse?›
EmbeddingGemma 300M (better), Yuan Embedding 2.0 En (open weights).