G

GritLM 8x7B

Feb 2024
GGritLM 8x7B
Compare in
on
self-host onlyprice
52.5MTEB English v2
Feb 2024released
4,096Dimensions
33K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1LCO Embedding Omni 7B39.72LGAI Embedding Preview38.93Gemini Embedding 00138.34ICT TIME And Querit Embedding v1385Giga Embeddings Instruct37.7
···
22GritLM 7B35.723GritLM 8x7B35.624SFR Embedding 2 R35.5

Strong at

B
Embeddings & Retrieval#85 of 200

Run it yourself

estimate
Fits on✗ 8 GB (phone, laptop)✗ 16 GB✗ 24 GB GPU✓ 48 GB GPU · compressed✓ 80 GB GPU · 8-bit
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English55.1#45
BEIR · Mean over task types · English55.1#45
BEIR · Retrieval · English55.1#45
JMTEB v2 · Clustering · Japanese54.2#16
JMTEB v2 · STS · Japanese83.2#17
LongEmbed · Mean over tasks · English44.2#53
LongEmbed · Mean over task types · English44.2#53
LongEmbed · Retrieval · English44.2#53
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)62.3#8
MTEB Europe v1 · Mean over task types · multilingual (29 languages)55.8#8
MTEB Europe v1 · Retrieval · multilingual (25 languages)56.5#21
MTEB Europe v1 · STS · multilingual (8 languages)75.1#12
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)89#27
MTEB Europe v1 · Classification · multilingual (23 languages)63.1#14
MTEB Europe v1 · Clustering · multilingual (29 languages)47.3#26
MTEB Europe v1 · Instruction Reranking · English2.4#22
MTEB Europe v1 · Pair Classification · multilingual (11 languages)89.4#17
MTEB Europe v1 · Reranking · multilingual (12 languages)59.9#35
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)19.2#30
MTEB French v1 · Pair Classification · French62.2#51
MTEB Indic v1 · Retrieval · multilingual (14 languages)77.4#30
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)62#32
MTEB Indic v1 · Reranking · multilingual (2 languages)83.1#61
MTEB Indic v1 · Pair Classification · Hindi72.6#53
MTEB Indic v1 · STS · multilingual (13 languages)27.2#72
MTEB Indic v1 · Clustering · multilingual (21 languages)40.4#35
MTEB Dutch v1 · Reranking · Dutch91.2#20
MTEB Portuguese v1 · Multilabel Classification · Portuguese21.8#41
MTEB Law v1 · Mean over tasks · multilingual (3 languages)54.1#42
MTEB Law v1 · Mean over task types · multilingual (3 languages)54.1#42
MTEB Law v1 · Retrieval · multilingual (3 languages)54.1#42
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)60.9#20
MTEB Medical v1 · Mean over task types · multilingual (10 languages)59#22
MTEB Medical v1 · Retrieval · multilingual (10 languages)64.3#20
MTEB Medical v1 · Clustering · English40.1#52
MTEB Medical v1 · Reranking · Mandarin Chinese72.8#73
FollowIR · Mean over tasks · English2.4#22
FollowIR · Mean over task types · English2.4#22
FollowIR · Instruction Reranking · English2.4#22
MTEB Spanish v1 · Pair Classification · Spanish69.4#38
MTEB Thai v1 · Clustering · Thai54.5#30
MTEB Thai v1 · Pair Classification · Thai70.1#56
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)47.5#14
MTEB Scandinavian v1 · Classification · multilingual (6 languages)66.7#14
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)71.4#37
MTEB Russian v1.1 · Pair Classification · Russian58.2#57
RTEB French beta · Mean over tasks · multilingual (2 languages)58.8#12
RTEB German beta · Mean over tasks · German46.8#68
RTEB Law beta · Mean over tasks · multilingual (4 languages)46.8#56
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)60.5#34
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)53.3#32
MTEB multilingual v2 · Classification · multilingual (119 languages)61.5#36
MTEB multilingual v2 · Clustering · multilingual (208 languages)50.2#37
MTEB multilingual v2 · STS · multilingual (35 languages)73.2#39
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)79.7#43
MTEB multilingual v2 · Retrieval · multilingual (120 languages)57.5#54
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)68.2#47
MTEB multilingual v2 · Instruction Reranking · English2.4#22
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)24.4#34
MTEB multilingual v2 · Reranking · multilingual (22 languages)62.6#46

FAQ

How much does GritLM 8x7B cost?›

There is no per-unit API price: self-host only.

Is GritLM 8x7B free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is GritLM 8x7B, and what is it best at?›

#85 of 200 in Embeddings.

Is GritLM 8x7B better than GritLM 7B?›

On MTEB English v2 · Summarization · English, GritLM 8x7B scores 35.6 vs 35.7 — about the same.

When was GritLM 8x7B released? Is there a newer version?›

Released 2024-02-15. It is the current version in its line.

Is GritLM 8x7B open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run GritLM 8x7B locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is GritLM 8x7B?›

GritLM 8x7B is an open-weights embeddings & retrieval model from GritLM, released Feb 2024.

What are the best alternatives to GritLM 8x7B?›

Gemini Embedding 001 (better), LGAI Embedding Preview (open weights).