G

GritLM 7B

Feb 2024
GGritLM 7B
Compare in
on
API price not publicprice
54.9MTEB English v2
Feb 2024released
4,096Dimensions
33K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1F2LLM v2 8B88.52F2LLM v2 14B88.53F2LLM v2 4B88.44F2LLM v2 1.7B88.15F2LLM v2 0.6B87.3
···
15Stella En 1.5B v57816GritLM 7B76.717Gte Qwen2 1.5B Instruct76

Strong at

B
Embeddings & Retrieval#60 of 200

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · 8-bit✓ 16 GB · full quality✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
LicenceApache-2.0free for commercial use

Benchmarks

in Embeddings & Retrieval
BRIGHT · Mean over tasks · English20.6#4
BRIGHT · Mean over task types · English20.6#4
BRIGHT · Retrieval · English20.6#4
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese65.1#57
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese61.4#53
MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese74.9#18
MTEB Persian v2 · Reranking · Persian71.3#17
JMTEB v2 · Clustering · Japanese54.5#12
JMTEB v2 · STS · Japanese84.1#10
LongEmbed · Mean over tasks · English47.1#47
LongEmbed · Mean over task types · English47.1#47
LongEmbed · Retrieval · English47.1#47
MTEB German v1 · Retrieval · German52.9#16
MTEB German v1 · Classification · German76.7#16
MTEB German v1 · Pair Classification · German54.7#25
MTEB German v1 · Reranking · German54#9
MTEB Europe v1 · Mean over tasks · multilingual (29 languages)63#7
MTEB Europe v1 · Mean over task types · multilingual (29 languages)56.1#7
MTEB Europe v1 · Retrieval · multilingual (25 languages)57.1#16
MTEB Europe v1 · STS · multilingual (8 languages)76.1#8
MTEB Europe v1 · Bitext Mining · multilingual (28 languages)90.4#14
MTEB Europe v1 · Classification · multilingual (23 languages)64.7#8
MTEB Europe v1 · Clustering · multilingual (29 languages)45.3#41
MTEB Europe v1 · Instruction Reranking · English3.5#18
MTEB Europe v1 · Pair Classification · multilingual (11 languages)89.9#10
MTEB Europe v1 · Reranking · multilingual (12 languages)60.3#27
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages)17.6#43
MTEB French v1 · Retrieval · multilingual (2 languages)65.9#5
MTEB French v1 · Reranking · French85.3#6
MTEB French v1 · Classification · French76.3#14
MTEB French v1 · Pair Classification · French61.6#54
MTEB Indic v1 · Mean over tasks · multilingual (25 languages)60.2#29
MTEB Indic v1 · Mean over task types · multilingual (25 languages)57.9#30
MTEB Indic v1 · Classification · multilingual (8 languages)60#41
MTEB Indic v1 · Retrieval · multilingual (14 languages)79.5#22
MTEB Indic v1 · Bitext Mining · multilingual (20 languages)58.4#37
MTEB Indic v1 · Reranking · multilingual (2 languages)84.7#44
MTEB Indic v1 · Pair Classification · Hindi67.8#68
MTEB Indic v1 · STS · multilingual (13 languages)27.2#71
MTEB Indic v1 · Clustering · multilingual (21 languages)28#75
MTEB Korean v2 · STS · Korean81.6#22
MTEB Korean v2 · Reranking · Korean55.6#28
MTEB Korean v2 · Classification · Korean66.7#8
MTEB Dutch v1 · Mean over tasks · Dutch38.4#92
MTEB Dutch v1 · Mean over task types · Dutch50.8#68
MTEB Dutch v1 · Classification · Dutch60.2#39
MTEB Dutch v1 · Clustering · Dutch17.7#106
MTEB Dutch v1 · Retrieval · Dutch18.1#118
MTEB Dutch v1 · STS · Dutch68.5#69
MTEB Dutch v1 · Multilabel Classification · Dutch26.2#109
MTEB Dutch v1 · Pair Classification · Dutch73.1#55
MTEB Dutch v1 · Reranking · Dutch92#8
MTEB Polish v1 · Pair Classification · Polish86.5#9
MTEB Polish v1 · Classification · Polish71.2#9
MTEB Portuguese v1 · Classification · Portuguese69.2#1
MTEB Portuguese v1 · Multilabel Classification · Portuguese18.8#119
MTEB Law v1 · Mean over tasks · multilingual (3 languages)56.7#26
MTEB Law v1 · Mean over task types · multilingual (3 languages)56.7#26
MTEB Law v1 · Retrieval · multilingual (3 languages)56.7#26
MTEB Medical v1 · Mean over tasks · multilingual (10 languages)61.5#15
MTEB Medical v1 · Mean over task types · multilingual (10 languages)60.3#20
MTEB Medical v1 · Retrieval · multilingual (10 languages)65.1#13
MTEB Medical v1 · Clustering · English36.7#79
MTEB Medical v1 · Reranking · Mandarin Chinese79#53
FollowIR · Mean over tasks · English3.5#18
FollowIR · Mean over task types · English3.5#18
FollowIR · Instruction Reranking · English3.5#18
MTEB Spanish v1 · Pair Classification · Spanish69.4#37
MTEB Spanish v1 · Reranking · Spanish61.5#20
MTEB Thai v1 · Clustering · Thai53.4#34
MTEB Thai v1 · Pair Classification · Thai70#57
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages)64.1#7
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages)65.3#6
MTEB Scandinavian v1 · Clustering · multilingual (2 languages)51.2#5
MTEB Scandinavian v1 · Classification · multilingual (6 languages)66.7#12
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages)66.5#21
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages)76.9#15
MTEB Russian v1.1 · Mean over tasks · Russian65#16
MTEB Russian v1.1 · Mean over task types · Russian62.2#15
MTEB Russian v1.1 · Classification · Russian69.9#17
MTEB Russian v1.1 · STS · Russian74.6#12
MTEB Russian v1.1 · Reranking · Russian70#12
MTEB Russian v1.1 · Clustering · Russian64.3#13
MTEB Russian v1.1 · Pair Classification · Russian58.9#48
MTEB Russian v1.1 · Retrieval · Russian55.5#39
MTEB Russian v1.1 · Multilabel Classification · Russian42#21
RTEB Finnish beta · Mean over tasks · English71.3#27
RTEB French beta · Mean over tasks · multilingual (2 languages)57.1#16
RTEB German beta · Mean over tasks · German44.2#78
RTEB Health beta · Mean over tasks · multilingual (4 languages)64.1#17
RTEB Law beta · Mean over tasks · multilingual (4 languages)48#46
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages)60.9#31
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages)53.7#31
MTEB multilingual v2 · Classification · multilingual (119 languages)61.8#33
MTEB multilingual v2 · Clustering · multilingual (208 languages)49.7#39
MTEB multilingual v2 · STS · multilingual (35 languages)73.3#38
MTEB multilingual v2 · Pair Classification · multilingual (24 languages)79.9#39
MTEB multilingual v2 · Retrieval · multilingual (120 languages)58.3#51
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages)70.5#29
MTEB multilingual v2 · Instruction Reranking · English3.5#18
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages)22.8#42
MTEB multilingual v2 · Reranking · multilingual (22 languages)63.8#35

FAQ

How much does GritLM 7B cost?›

There is no per-unit API price: API price not public.

Is GritLM 7B free to use?›

There is no free API. The weights are open, so you can run it yourself.

How good is GritLM 7B, and what is it best at?›

#60 of 200 in Embeddings.

Is GritLM 7B better than Stella En 1.5B v5?›

On MTEB German v1 · Classification · German, GritLM 7B scores 76.7 vs 78 — lower.

When was GritLM 7B released? Is there a newer version?›

Released 2024-02-15. It is the current version in its line.

Is GritLM 7B open source?›

Yes, the weights are open (Apache-2.0 licence).

Can I run GritLM 7B locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is GritLM 7B?›

GritLM 7B is an open-weights embeddings & retrieval model from GritLM, released Feb 2024.

What are the best alternatives to GritLM 7B?›

Jina Embeddings v5 Text Nano (better), F2LLM v2 8B (open weights).