Bge Multilingual Gemma2

Jul 2024
Bge Multilingual Gemma2
Compare in
on
$0.11per 1M tokens
86MTEB English v2
Jul 2024released
3,584Dimensions
8K tokensMax input

Rankingconfiguration unstated?

Full ranking →
1Jina Embeddings v372.82Bilingual Embedding Large713Gte Qwen2 7B Instruct70.84Mmlw Roberta Base70.75Bge Multilingual Gemma270.66Mmlw Roberta Large70.6

Alternatives?

ModelScoreCostPriceWhat changes
CheaperJina Embeddings v3unstatedOpen+3%-55%$0.05iCheaperMultilingual E5 Large InstructunstatedOpensame-91%$0.01Max input: 8K tokens → 1K tokensiCheaperE5 Mistral 7B InstructunstatedOpen-2%-80%$0.022LOpenBilingual Embedding Largeunstatedsame——Max input: 8K tokens → 1K tokensOpenGte Qwen2 7B Instructunstatedsame——

Run it yourself

estimate
Fits on✓ 8 GB (phone, laptop) · compressed✓ 16 GB · 8-bit✓ 24 GB GPU · full quality✓ 48 GB GPU · full quality✓ 80 GB GPU · full quality
Licencehttps://ai.google.dev/gemma/termscommercial use with conditions

Benchmarks

in Embeddings & Retrieval
BEIR · Mean over tasks · English59.2#15
BEIR · Mean over task types · English59.2#15
BEIR · Retrieval · English59.2#15
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese73.7#24
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese55.2#31
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese68.3#19
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese59.3#32
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese79.3#28
MTEB German v1 · Reranking · German26.5#78
MTEB French v1 · Reranking · French85.2#7
MTEB French v1 · Summarization · French31.3#25
MTEB French v1 · Pair Classification · French60.8#64
MTEB Indic v1 · Clustering · multilingual (21 languages)34.6#48
MTEB Korean v2 · Mean over tasks · multilingual (2 languages)67.4#15
MTEB Korean v2 · Mean over task types · multilingual (2 languages)62.6#19
MTEB Korean v2 · STS · Korean80.1#27
MTEB Korean v2 · Retrieval · multilingual (2 languages)70.1#21
MTEB Korean v2 · Pair Classification · Korean65.7#7
MTEB Korean v2 · Reranking · Korean36.8#54
MTEB Korean v2 · Classification · Korean62.7#14
MTEB Korean v2 · Clustering · Korean60.1#17
MTEB Polish v1 · Pair Classification · Polish89.8#2
MTEB Polish v1 · STS · Polish70.6#5
MTEB Medical v1 · Reranking · Mandarin Chinese85.6#34
MTEB Spanish v1 · Reranking · Spanish31.5#93
MTEB Thai v1 · Clustering · Thai39.6#75
VN-MTEB Vietnamese v1 · STS · Vietnamese66.1#27
VN-MTEB Vietnamese v1 · Retrieval · Vietnamese20.5#23
VN-MTEB Vietnamese v1 · Clustering · Vietnamese40.1#23
VN-MTEB Vietnamese v1 · Reranking · Vietnamese56.1#26
VN-MTEB Vietnamese v1 · Pair Classification · Vietnamese82.5#15

FAQ

How much does Bge Multilingual Gemma2 cost?›

$0.11 per 1M tokens.

Is Bge Multilingual Gemma2 free to use?›

There is no free API; it costs $0.11 per 1M tokens. The weights are open, so you can run it yourself.

How good is Bge Multilingual Gemma2, and what is it best at?›

#60 of 238 in Embeddings.

Is Bge Multilingual Gemma2 better than Mmlw Roberta Base?›

On MTEB Polish v1 · STS · Polish, Bge Multilingual Gemma2 scores 70.6 vs 70.7 — about the same.

When was Bge Multilingual Gemma2 released? Is there a newer version?›

Released 2024-07-25. It is the current version in its line.

Is Bge Multilingual Gemma2 open source?›

Yes, the weights are open (https://ai.google.dev/gemma/terms licence).

Can I run Bge Multilingual Gemma2 locally?›

The weights are open and can be self-hosted; hardware needs are not confirmed yet.

What is Bge Multilingual Gemma2?›

Bge Multilingual Gemma2 is an open-weights embeddings & retrieval model from BAAI, released Jul 2024.

What are the best alternatives to Bge Multilingual Gemma2?›

Jina Embeddings v3 (cheaper).