GritLM 7B vs GritLM 8x7B
| Benchmark | GritLM 7B | GritLM 8x7B |
|---|---|---|
| MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages) | 60.9 | 60.5 |
Specs
| Spec | GritLM 7B | GritLM 8x7B |
|---|---|---|
| Context | 33K | 33K |
| Weights | Open | Open |
| Released | Feb 2024 | Feb 2024 |
| Dimensions | 4,096 | 4,096 |
| Max input | 33K tokens | 33K tokens |
| Memory (4-bit) | 4.3 GB | 35 GB |
| Licence | Apache-2.0 | Apache-2.0 |
| Commercial use | Allowed | Allowed |
What breaks when you switch
GritLM 7B → GritLM 8x7B
Re-embed your whole corpus›
Vectors from different models can't be mixed.
Memory (4-bit): 4.3 GB → 35 GB
GritLM 8x7B → GritLM 7B
Re-embed your whole corpus›
Vectors from different models can't be mixed.