LLM2Vec Sheared Llama Mntp Unsup Simcse measured on 6 of 261 Embeddings benchmarks6
BenchmarkByScoreRank
No benchmark matches
self-host onlyprice
72.2MTEB English v2
Apr 2024released
33K tokensMax input
enLanguages
Alternatives?
ModelScoreCostPriceWhat changes
BetterEmbeddingGemma 300MunstatedOpen+21%—$0.002Max input: 33K tokens → 2K tokens+1KOpenQZhou Embeddingunstated+28%——Memory (4-bit): 0.8 GB → 4.2 GB
BetterBge Base En v1.5unstatedOpen+20%—$0.005Max input: 33K tokens → 1K tokensiBetterE5 Base v2unstatedOpen+19%—$0.005Max input: 33K tokens → 1K tokenstBetterGte BaseunstatedOpen+17%—$0.005Max input: 33K tokens → 1K tokensModelScoreCostPriceWhat changes
Nothing here yet.
ModelScoreCostPriceWhat changes
EmbeddingGemma 300MunstatedOpen+21%—$0.002Max input: 33K tokens → 2K tokens+1Bge Base En v1.5unstatedOpen+20%—$0.005Max input: 33K tokens → 1K tokensiE5 Base v2unstatedOpen+19%—$0.005Max input: 33K tokens → 1K tokenstGte BaseunstatedOpen+17%—$0.005Max input: 33K tokens → 1K tokenssAll Mpnet Base v2unstatedOpen+15%—$0.005Max input: 33K tokens → 0K tokensModelScoreCostPriceWhat changes
KQZhou EmbeddingunstatedOpen+28%——Memory (4-bit): 0.8 GB → 4.2 GBiJasper Token Compression 600MunstatedOpen+25%——KNano Em1 0.6B v2.1unstatedOpen+24%——Max input: 33K tokens → 8K tokens
NV Embed v2unstatedOpen+23%——Memory (4-bit): 0.8 GB → 4.7 GBaLGAI Embedding PreviewunstatedOpen+23%——Memory (4-bit): 0.8 GB → 4.3 GBModelScoreCostPriceWhat changes
MLLM2Vec Llama 2 7B Chat Hf Mntp SupervisedunstatedOpen+22%——Memory (4-bit): 0.8 GB → 4 GBMLLM2Vec Mistral 7B Instruct v2 Mntp SupervisedunstatedOpen+22%——Memory (4-bit): 0.8 GB → 4.3 GBMLLM2Vec Meta Llama 3 8B Instruct Mntp SupervisedunstatedOpen+22%——Max input: 33K tokens → 8K tokens+1MLLM2Vec Sheared Llama Mntp SupervisedunstatedOpen+19%——MLLM2Vec Mistral 7B Instruct v2 Mntp Unsup SimcseunstatedOpen+12%——Memory (4-bit): 0.8 GB → 4.3 GBMLLM2Vec Meta Llama 3 8B Instruct Mntp Unsup SimcseunstatedOpen+8%——Max input: 33K tokens → 8K tokens+1MLLM2Vec Llama 2 7B Chat Hf Mntp Unsup SimcseunstatedOpen+8%——Memory (4-bit): 0.8 GB → 4 GBAll McGill-NLP models →Run it yourself
estimateFits on✓ 8 GB (phone, laptop) · full quality✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceMITfree for commercial use
Benchmarks
in Embeddings & RetrievalBEIR · Mean over tasks · English25.9#173
BEIR · Retrieval · English25.9#173
FAQ
How much does LLM2Vec Sheared Llama Mntp Unsup Simcse cost?›
There is no per-unit API price: self-host only.
Is LLM2Vec Sheared Llama Mntp Unsup Simcse free to use?›
There is no free API. The weights are open, so you can run it yourself.
How good is LLM2Vec Sheared Llama Mntp Unsup Simcse, and what is it best at?›
#222 of 238 in Embeddings.
Is LLM2Vec Sheared Llama Mntp Unsup Simcse better than Potion Base 2M?›
On MTEB English v2 · Pair Classification · English, LLM2Vec Sheared Llama Mntp Unsup Simcse scores 72.2 vs 73.7 — lower.
When was LLM2Vec Sheared Llama Mntp Unsup Simcse released? Is there a newer version?›
Released 2024-04-09. It is the current version in its line.
Is LLM2Vec Sheared Llama Mntp Unsup Simcse open source?›
Yes, the weights are open (MIT licence).
Can I run LLM2Vec Sheared Llama Mntp Unsup Simcse locally?›
The weights are open and can be self-hosted; hardware needs are not confirmed yet.
What is LLM2Vec Sheared Llama Mntp Unsup Simcse?›
LLM2Vec Sheared Llama Mntp Unsup Simcse is an open-weights embeddings & retrieval model from McGill-NLP, released Apr 2024.
What are the best alternatives to LLM2Vec Sheared Llama Mntp Unsup Simcse?›
EmbeddingGemma 300M (better), QZhou Embedding (open weights).