Gte Qwen1.5 7B Instruct

Apr 2024
Gte Qwen1.5 7B Instruct
Compare in
on
self-host onlyprice
56.2MTEB English v2
Apr 2024released
33K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1Yuan Embedding 2.0 Zh94.42QZhou Embedding93.53Youtu Embedding92.64QZhou Embedding Zh92.65Gme Qwen2 VL 7B Instruct90.5
···
23Gme Qwen2 VL 2B Instruct87.624Gte Qwen1.5 7B Instruct87.425Gte Multilingual Base87.4

Strong at

A
Embeddings & Retrieval#49 of 200

Alternatives?

ModelScoreCostPriceWhat changes
IBetterYuan Embedding 2.0 ZhOpen+8%——Max input: 33K tokens → 1K tokensKBetterQZhou EmbeddingunstatedOpen+7%——BetterYoutu EmbeddingOpen+6%——Max input: 33K tokens → 1K tokensKBetterQZhou Embedding ZhOpen+6%——Max input: 33K tokens → 8K tokens+1rBetterRitrieve Zh v1Open+4%——Max input: 33K tokens → 1K tokens

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

History

2 versions
87.58888.58989.5Release dateMTEB Medical v1 · Reranking1.5 7B Instruct2 7B Instruct
87.58888.58989.5Release dateMTEB Medical v1 · Reranking

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English56.2#31
BEIR · Mean over task types · English56.2#31
BEIR · Retrieval · English56.2#31
BRIGHT · Mean over tasks · English22.1#3
BRIGHT · Mean over task types · English22.1#3
BRIGHT · Retrieval · English22.1#3
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese70.6#43
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese61.6#20
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese67.1#18
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese82.5#20
MTEB Persian v2 · Reranking · Persian59.4#48
JMTEB v2 · Clustering · Japanese53.6#18
JMTEB v2 · STS · Japanese76.7#62
LongEmbed · Mean over tasks · English41.8#63
LongEmbed · Mean over task types · English41.8#63
LongEmbed · Retrieval · English41.8#63
MTEB German v1 · Clustering · German39.6#13
MTEB German v1 · Classification · German74.9#18
MTEB German v1 · STS · German68.1#35
MTEB German v1 · Pair Classification · German62#3
MTEB German v1 · Reranking · German49.6#31
MTEB Europe v1 · Retrieval · multilingual (25 languages)57.2#15
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)85.6#53
MTEB Europe v1 · Classification · multilingual (23 languages)61.6#19
MTEB Europe v1 · Clustering · multilingual (29 languages)47.2#27
MTEB Europe v1 · Instruction Reranking · English5.4#11
MTEB Europe v1 · Pair Classification · multilingual (11 languages)92.8#1
MTEB Europe v1 · Reranking · multilingual (12 languages)59#44
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)17.5#44
MTEB French v1 · Mean over tasks · multilingual (2 languages)65.9#11
MTEB French v1 · Mean over task types · multilingual (2 languages)65.6#7
MTEB French v1 · STS · French80#14
MTEB French v1 · Retrieval · multilingual (2 languages)59#19
MTEB French v1 · Reranking · French81.3#20
MTEB French v1 · Clustering · French55.8#11
MTEB French v1 · Classification · French75.2#15
MTEB French v1 · Summarization · French30#86
MTEB French v1 · Pair Classification · French77.9#4
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)59.6#33
MTEB Indic v1 · Mean over task types · multilingual (25 languages)56.3#35
MTEB Indic v1 · Classification · multilingual (8 languages)62.2#29
MTEB Indic v1 · Retrieval · multilingual (14 languages)65.3#47
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)49.1#43
MTEB Indic v1 · Reranking · multilingual (2 languages)82.9#63
MTEB Indic v1 · Pair Classification · Hindi79#21
MTEB Indic v1 · STS · multilingual (13 languages)23.9#75
MTEB Indic v1 · Clustering · multilingual (21 languages)31.8#66
MTEB Korean v2 · Reranking · Korean41.4#51
MTEB Korean v2 · Classification · Korean60.8#19
MTEB Dutch v1 · Reranking · Dutch89.3#40
MTEB Polish v1 · Pair Classification · Polish86.4#10
MTEB Polish v1 · Classification · Polish64.9#20
MTEB Polish v1 · STS · Polish66.4#31
MTEB Portuguese v1 · Multilabel Classification · Portuguese21.5#45
MTEB Law v1 · Mean over tasks · multilingual (3 languages)51.6#47
MTEB Law v1 · Mean over task types · multilingual (3 languages)51.6#47
MTEB Law v1 · Retrieval · multilingual (3 languages)51.6#47
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)62.2#13
MTEB Medical v1 · Mean over task types · multilingual (10 languages)66#5
MTEB Medical v1 · Retrieval · multilingual (10 languages)62.5#22
MTEB Medical v1 · Clustering · English48.1#17
MTEB Medical v1 · Reranking · Mandarin Chinese87.4#24
FollowIR · Mean over tasks · English5.4#11
FollowIR · Mean over task types · English5.4#11
FollowIR · Instruction Reranking · English5.4#11
MTEB Spanish v1 · Pair Classification · Spanish83.5#4
MTEB Spanish v1 · Clustering · Spanish48.7#22
MTEB Spanish v1 · Reranking · Spanish55.9#42
MTEB Thai v1 · Clustering · Thai53.9#33
MTEB Thai v1 · Pair Classification · Thai79.9#18
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)49.3#12
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)66.5#80
MTEB Russian v1.1 · Classification · Russian69.5#20
MTEB Russian v1.1 · STS · Russian71.3#40
MTEB Russian v1.1 · Reranking · Russian62.8#44
MTEB Russian v1.1 · Clustering · Russian63.8#16
MTEB Russian v1.1 · Pair Classification · Russian69.5#5
MTEB Russian v1.1 · Multilabel Classification · Russian45.2#10
RTEB French beta · Mean over tasks · multilingual (2 languages)41.8#63
RTEB German beta · Mean over tasks · German38#88
RTEB Law beta · Mean over tasks · multilingual (4 languages)41.4#76
MTEB multilingual v2 · Classification · multilingual (119 languages)58.2#49
MTEB multilingual v2 · Clustering · multilingual (208 languages)52.3#28
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)84.6#8
MTEB multilingual v2 · Retrieval · multilingual (120 languages)57.8#53
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)60.8#66
MTEB multilingual v2 · Instruction Reranking · English5.4#11
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)23.5#38

FAQ

How much does Gte Qwen1.5 7B Instruct cost?›

There is no per-unit API price: self-host only.

Is Gte Qwen1.5 7B Instruct free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is Gte Qwen1.5 7B Instruct, and what is it best at?›

#49 of 200 in Embeddings. Strongest at: Embeddings & Retrieval.

Is Gte Qwen1.5 7B Instruct better than Gme Qwen2 VL 2B Instruct?›

On MTEB Medical v1 · Reranking · Mandarin Chinese, Gte Qwen1.5 7B Instruct scores 87.4 vs 87.6 — about the same.

When was Gte Qwen1.5 7B Instruct released? Is there a newer version?›

Released 2024-04-20. It is the current version in its line.

Is Gte Qwen1.5 7B Instruct open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run Gte Qwen1.5 7B Instruct locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Gte Qwen1.5 7B Instruct?›

Gte Qwen1.5 7B Instruct is an open-weights embeddings & retrieval model from Alibaba (Qwen), released Apr 2024.

What are the best alternatives to Gte Qwen1.5 7B Instruct?›

Yuan Embedding 2.0 Zh (better).