F2LLM 4B vs F2LLM v2 4B
MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages) Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs, rank relevant documents for queries, find translated sentence pairs, rerank documents according to instructions, assign multiple labels to each example, reorder candidate documents by relevance on MTEB Multilingual v2 · mean over tasks in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B67.1
MTEB Medical v1 · Clustering · English Embeddings group similar examples on MTEB Medical v1 · Clustering in English
F2LLM 4B71.1
F2LLM v2 4B55.5
MTEB English v2 · Pair Classification · English MTEB English v2 · Pair Classification · English: embeddings classify relationships between pairs in English
F2LLM 4B83.8
F2LLM v2 4B85.1
MTEB English v2 · Classification · English MTEB English v2 · Classification · English: embeddings assign examples to categories in English
F2LLM 4B91.7
F2LLM v2 4B91.7
MTEB English v2 · Reranking · English MTEB English v2 · Reranking · English: embeddings reorder candidate documents by relevance in English
F2LLM 4B50
F2LLM v2 4B50.1
MTEB English v2 · STS · English MTEB English v2 · STS · English: embeddings estimate semantic similarity between pairs in English
F2LLM 4B84.2
F2LLM v2 4B84.2
MTEB English v2 · Retrieval · English MTEB English v2 · Retrieval · English: embeddings rank relevant documents for queries in English
F2LLM 4B59.6
F2LLM v2 4B59.1
MTEB English v2 · Clustering · English MTEB English v2 · Clustering · English: embeddings group similar examples in English
F2LLM 4B68.5
F2LLM v2 4B62
MTEB English v2 · Summarization · English MTEB English v2 · Summarization · English: embeddings match summaries to their source meaning in English
F2LLM 4B33.2
F2LLM v2 4B34.5
BEIR · Mean over tasks · English Embeddings rank relevant documents for queries on BEIR · mean over tasks in English; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B56.9
BEIR · Mean over task types · English Embeddings rank relevant documents for queries on BEIR · mean over task types in English; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B56.9
BEIR · Retrieval · English Embeddings rank relevant documents for queries on BEIR · Retrieval in English
F2LLM 4B—
F2LLM v2 4B56.9
BRIGHT · Mean over tasks · English Embeddings rank relevant documents for queries on BRIGHT · mean over tasks in English; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B16.4
BRIGHT · Mean over task types · English Embeddings rank relevant documents for queries on BRIGHT · mean over task types in English; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B16.4
BRIGHT · Retrieval · English Embeddings rank relevant documents for queries on BRIGHT · Retrieval in English
F2LLM 4B—
F2LLM v2 4B16.4
ChemTEB · Mean over tasks · multilingual (13 languages) Embeddings assign examples to categories, rank relevant documents for queries, classify relationships between pairs, group similar examples, find translated sentence pairs on cheMTEB · mean over tasks in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B76.5
ChemTEB · Mean over task types · multilingual (13 languages) Embeddings assign examples to categories, rank relevant documents for queries, classify relationships between pairs, group similar examples, find translated sentence pairs on cheMTEB · mean over task types in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B56.7
ChemTEB · Bitext Mining · English Embeddings find translated sentence pairs on cheMTEB · Bitext Mining in English
F2LLM 4B—
F2LLM v2 4B1.6
ChemTEB · Classification · English Embeddings assign examples to categories on cheMTEB · Classification in English
F2LLM 4B—
F2LLM v2 4B85.1
ChemTEB · Clustering · English Embeddings group similar examples on cheMTEB · Clustering in English
F2LLM 4B—
F2LLM v2 4B46.5
ChemTEB · Pair Classification · multilingual (13 languages) Embeddings classify relationships between pairs on cheMTEB · Pair Classification in Chinese, Czech, Dutch, English, French, German, Hindi, Japanese, Korean, Malay (macrolanguage), Portuguese, Spanish, Turkish
F2LLM 4B—
F2LLM v2 4B73.9
ChemTEB · Retrieval · English Embeddings rank relevant documents for queries on cheMTEB · Retrieval in English
F2LLM 4B—
F2LLM v2 4B76.5
CoIR · Mean over tasks · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · mean over tasks in English, c++, go, java, javascript, php, python, ruby, sql; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B79.6
CoIR · Mean over task types · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · mean over task types in English, c++, go, java, javascript, php, python, ruby, sql; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B79.6
CoIR · Retrieval · multilingual (9 languages) Embeddings rank relevant documents for queries on CoIR · Retrieval in English, c++, go, java, javascript, php, python, ruby, sql
F2LLM 4B—
F2LLM v2 4B79.6
CoREB v1 · Mean over tasks · multilingual (6 languages) Embeddings reorder candidate documents by relevance, rank relevant documents for queries on CoReB v1 · mean over tasks in English, c++, go, java, python, ruby; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B59.5
CoREB v1 · Mean over task types · multilingual (6 languages) Embeddings reorder candidate documents by relevance, rank relevant documents for queries on CoReB v1 · mean over task types in English, c++, go, java, python, ruby; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B59.5
CoREB v1 · Reranking · multilingual (6 languages) Embeddings reorder candidate documents by relevance on CoReB v1 · Reranking in English, c++, go, java, python, ruby
F2LLM 4B—
F2LLM v2 4B54.3
CoREB v1 · Retrieval · multilingual (6 languages) Embeddings rank relevant documents for queries on CoReB v1 · Retrieval in English, c++, go, java, python, ruby
F2LLM 4B—
F2LLM v2 4B64.7
FollowIR · Mean over tasks · English Embeddings rerank documents according to instructions on FollowIR · mean over tasks in English; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B2.2
FollowIR · Mean over task types · English Embeddings rerank documents according to instructions on FollowIR · mean over task types in English; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B2.2
FollowIR · Instruction Reranking · English Embeddings rerank documents according to instructions on FollowIR · Instruction Reranking in English
F2LLM 4B—
F2LLM v2 4B2.2
JMTEB v2 · Mean over tasks · Japanese Embeddings group similar examples, assign examples to categories, rank relevant documents for queries, estimate semantic similarity between pairs, reorder candidate documents by relevance on jMTEB v2 · mean over tasks in Japanese; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B77.4
JMTEB v2 · Mean over task types · Japanese Embeddings group similar examples, assign examples to categories, rank relevant documents for queries, estimate semantic similarity between pairs, reorder candidate documents by relevance on jMTEB v2 · mean over task types in Japanese; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B77.6
JMTEB v2 · Classification · Japanese Embeddings assign examples to categories on jMTEB v2 · Classification in Japanese
F2LLM 4B—
F2LLM v2 4B80.4
JMTEB v2 · Clustering · Japanese Embeddings group similar examples on jMTEB v2 · Clustering in Japanese
F2LLM 4B—
F2LLM v2 4B70.5
JMTEB v2 · Reranking · Japanese Embeddings reorder candidate documents by relevance on jMTEB v2 · Reranking in Japanese
F2LLM 4B—
F2LLM v2 4B75.4
JMTEB v2 · Retrieval · Japanese Embeddings rank relevant documents for queries on jMTEB v2 · Retrieval in Japanese
F2LLM 4B—
F2LLM v2 4B77
JMTEB v2 · STS · Japanese Embeddings estimate semantic similarity between pairs on jMTEB v2 · STS in Japanese
F2LLM 4B—
F2LLM v2 4B84.7
LongEmbed · Mean over tasks · English Embeddings rank relevant documents for queries on LongEmbed · mean over tasks in English; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B75.4
LongEmbed · Mean over task types · English Embeddings rank relevant documents for queries on LongEmbed · mean over task types in English; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B75.4
LongEmbed · Retrieval · English Embeddings rank relevant documents for queries on LongEmbed · Retrieval in English
F2LLM 4B—
F2LLM v2 4B75.4
MTEB Mandarin Chinese v1 · Mean over tasks · Mandarin Chinese Embeddings rank relevant documents for queries, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, assign examples to categories on MTEB Chinese v1 · mean over tasks in Mandarin Chinese; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B67.1
MTEB Mandarin Chinese v1 · Mean over task types · Mandarin Chinese Embeddings rank relevant documents for queries, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, assign examples to categories on MTEB Chinese v1 · mean over task types in Mandarin Chinese; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B67.4
MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese Embeddings assign examples to categories on MTEB Chinese v1 · Classification in Mandarin Chinese
F2LLM 4B—
F2LLM v2 4B76.5
MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese Embeddings group similar examples on MTEB Chinese v1 · Clustering in Mandarin Chinese
F2LLM 4B—
F2LLM v2 4B70.3
MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese Embeddings classify relationships between pairs on MTEB Chinese v1 · Pair Classification in Mandarin Chinese
F2LLM 4B—
F2LLM v2 4B67
MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Chinese v1 · Reranking in Mandarin Chinese
F2LLM 4B—
F2LLM v2 4B66.8
MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese Embeddings rank relevant documents for queries on MTEB Chinese v1 · Retrieval in Mandarin Chinese
F2LLM 4B—
F2LLM v2 4B72.7
MTEB Mandarin Chinese v1 · STS · Mandarin Chinese Embeddings estimate semantic similarity between pairs on MTEB Chinese v1 · STS in Mandarin Chinese
F2LLM 4B—
F2LLM v2 4B51.2
MTEB Code v1 · Mean over tasks · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · mean over tasks in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B80.2
MTEB Code v1 · Mean over task types · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · mean over task types in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B80.2
MTEB Code v1 · Retrieval · multilingual (15 languages) Embeddings rank relevant documents for queries on MTEB Code v1 · Retrieval in English, c, c++, go, java, javascript, php, python, ruby, rust, scala, shell, sql, swift, typescript
F2LLM 4B—
F2LLM v2 4B80.2
MTEB German v1 · Mean over tasks · German Embeddings group similar examples, rank relevant documents for queries, assign examples to categories, estimate semantic similarity between pairs, classify relationships between pairs, reorder candidate documents by relevance on MTEB German v1 · mean over tasks in German; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B66.1
MTEB German v1 · Mean over task types · German Embeddings group similar examples, rank relevant documents for queries, assign examples to categories, estimate semantic similarity between pairs, classify relationships between pairs, reorder candidate documents by relevance on MTEB German v1 · mean over task types in German; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B62.5
MTEB German v1 · Classification · German Embeddings assign examples to categories on MTEB German v1 · Classification in German
F2LLM 4B—
F2LLM v2 4B88.4
MTEB German v1 · Clustering · German Embeddings group similar examples on MTEB German v1 · Clustering in German
F2LLM 4B—
F2LLM v2 4B43.7
MTEB German v1 · Pair Classification · German Embeddings classify relationships between pairs on MTEB German v1 · Pair Classification in German
F2LLM 4B—
F2LLM v2 4B59
MTEB German v1 · Reranking · German Embeddings reorder candidate documents by relevance on MTEB German v1 · Reranking in German
F2LLM 4B—
F2LLM v2 4B51.7
MTEB German v1 · Retrieval · German Embeddings rank relevant documents for queries on MTEB German v1 · Retrieval in German
F2LLM 4B—
F2LLM v2 4B58
MTEB German v1 · STS · German Embeddings estimate semantic similarity between pairs on MTEB German v1 · STS in German
F2LLM 4B—
F2LLM v2 4B74.2
MTEB Europe v1 · Mean over tasks · multilingual (29 languages) Embeddings rank relevant documents for queries, estimate semantic similarity between pairs, find translated sentence pairs, assign examples to categories, group similar examples, rerank documents according to instructions, classify relationships between pairs, reorder candidate documents by relevance, assign multiple labels to each example on MTEB Europe v1 · mean over tasks in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B68.6
MTEB Europe v1 · Mean over task types · multilingual (29 languages) Embeddings rank relevant documents for queries, estimate semantic similarity between pairs, find translated sentence pairs, assign examples to categories, group similar examples, rerank documents according to instructions, classify relationships between pairs, reorder candidate documents by relevance, assign multiple labels to each example on MTEB Europe v1 · mean over task types in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B59.9
MTEB Europe v1 · Bitext Mining · multilingual (28 languages) Embeddings find translated sentence pairs on MTEB Europe v1 · Bitext Mining in 28 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian
F2LLM 4B—
F2LLM v2 4B89.6
MTEB Europe v1 · Classification · multilingual (23 languages) Embeddings assign examples to categories on MTEB Europe v1 · Classification in 23 languages including Bulgarian, Czech, Danish, Dutch, English, Estonian, Finnish, French
F2LLM 4B—
F2LLM v2 4B74.2
MTEB Europe v1 · Clustering · multilingual (29 languages) Embeddings group similar examples on MTEB Europe v1 · Clustering in 29 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian
F2LLM 4B—
F2LLM v2 4B56.4
MTEB Europe v1 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Europe v1 · Instruction Reranking in English
F2LLM 4B—
F2LLM v2 4B2.2
MTEB Europe v1 · Multilabel Classification · multilingual (23 languages) Embeddings assign multiple labels to each example on MTEB Europe v1 · Multilabel Classification in 23 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish
F2LLM 4B—
F2LLM v2 4B22.3
MTEB Europe v1 · Pair Classification · multilingual (11 languages) Embeddings classify relationships between pairs on MTEB Europe v1 · Pair Classification in Bulgarian, Czech, English, Finnish, French, German, Italian, Modern Greek (1453-), Polish, Spanish, Swedish
F2LLM 4B—
F2LLM v2 4B89.2
MTEB Europe v1 · Reranking · multilingual (12 languages) Embeddings reorder candidate documents by relevance on MTEB Europe v1 · Reranking in Bulgarian, Czech, Danish, Dutch, English, Finnish, French, German, Italian, Portuguese, Romanian, Swedish
F2LLM 4B—
F2LLM v2 4B63.7
MTEB Europe v1 · Retrieval · multilingual (25 languages) Embeddings rank relevant documents for queries on MTEB Europe v1 · Retrieval in 25 languages including Basque, Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian
F2LLM 4B—
F2LLM v2 4B65.7
MTEB Europe v1 · STS · multilingual (8 languages) Embeddings estimate semantic similarity between pairs on MTEB Europe v1 · STS in Dutch, English, Finnish, French, German, Italian, Polish, Spanish
F2LLM 4B—
F2LLM v2 4B76
MTEB Persian v2 · Mean over tasks · Persian Embeddings estimate semantic similarity between pairs, group similar examples, assign examples to categories, rank relevant documents for queries, reorder candidate documents by relevance, find translated sentence pairs, classify relationships between pairs on MTEB Persian v2 · mean over tasks in Persian; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B72.1
MTEB Persian v2 · Mean over task types · Persian Embeddings estimate semantic similarity between pairs, group similar examples, assign examples to categories, rank relevant documents for queries, reorder candidate documents by relevance, find translated sentence pairs, classify relationships between pairs on MTEB Persian v2 · mean over task types in Persian; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B74.3
MTEB Persian v2 · Bitext Mining · Persian Embeddings find translated sentence pairs on MTEB Persian v2 · Bitext Mining in Persian
F2LLM 4B—
F2LLM v2 4B77.1
MTEB Persian v2 · Classification · Persian Embeddings assign examples to categories on MTEB Persian v2 · Classification in Persian
F2LLM 4B—
F2LLM v2 4B74
MTEB Persian v2 · Clustering · Persian Embeddings group similar examples on MTEB Persian v2 · Clustering in Persian
F2LLM 4B—
F2LLM v2 4B67.5
MTEB Persian v2 · Pair Classification · Persian Embeddings classify relationships between pairs on MTEB Persian v2 · Pair Classification in Persian
F2LLM 4B—
F2LLM v2 4B86.4
MTEB Persian v2 · Reranking · Persian Embeddings reorder candidate documents by relevance on MTEB Persian v2 · Reranking in Persian
F2LLM 4B—
F2LLM v2 4B72.5
MTEB Persian v2 · Retrieval · Persian Embeddings rank relevant documents for queries on MTEB Persian v2 · Retrieval in Persian
F2LLM 4B—
F2LLM v2 4B64
MTEB Persian v2 · STS · Persian Embeddings estimate semantic similarity between pairs on MTEB Persian v2 · STS in Persian
F2LLM 4B—
F2LLM v2 4B79
MTEB French v1 · Mean over tasks · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, rank relevant documents for queries, reorder candidate documents by relevance, group similar examples, assign examples to categories, match summaries to their source meaning, classify relationships between pairs on MTEB French v1 · mean over tasks in English, French; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B71.2
MTEB French v1 · Mean over task types · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, rank relevant documents for queries, reorder candidate documents by relevance, group similar examples, assign examples to categories, match summaries to their source meaning, classify relationships between pairs on MTEB French v1 · mean over task types in English, French; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B69
MTEB French v1 · Classification · French Embeddings assign examples to categories on MTEB French v1 · Classification in French
F2LLM 4B—
F2LLM v2 4B85.3
MTEB French v1 · Clustering · French Embeddings group similar examples on MTEB French v1 · Clustering in French
F2LLM 4B—
F2LLM v2 4B56.9
MTEB French v1 · Pair Classification · French Embeddings classify relationships between pairs on MTEB French v1 · Pair Classification in French
F2LLM 4B—
F2LLM v2 4B70.1
MTEB French v1 · Reranking · French Embeddings reorder candidate documents by relevance on MTEB French v1 · Reranking in French
F2LLM 4B—
F2LLM v2 4B86.6
MTEB French v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB French v1 · Retrieval in English, French
F2LLM 4B—
F2LLM v2 4B69.1
MTEB French v1 · STS · French Embeddings estimate semantic similarity between pairs on MTEB French v1 · STS in French
F2LLM 4B—
F2LLM v2 4B83.5
MTEB French v1 · Summarization · French Embeddings match summaries to their source meaning on MTEB French v1 · Summarization in French
F2LLM 4B—
F2LLM v2 4B31.4
MTEB Indic v1 · Mean over tasks · multilingual (25 languages) Embeddings assign examples to categories, rank relevant documents for queries, find translated sentence pairs, reorder candidate documents by relevance, classify relationships between pairs, estimate semantic similarity between pairs, group similar examples on MTEB Indic v1 · mean over tasks in 25 languages including Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Dogri (macrolanguage), English, Goan Konkani; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B76.6
MTEB Indic v1 · Mean over task types · multilingual (25 languages) Embeddings assign examples to categories, rank relevant documents for queries, find translated sentence pairs, reorder candidate documents by relevance, classify relationships between pairs, estimate semantic similarity between pairs, group similar examples on MTEB Indic v1 · mean over task types in 25 languages including Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Dogri (macrolanguage), English, Goan Konkani; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B77.8
MTEB Indic v1 · Bitext Mining · multilingual (20 languages) Embeddings find translated sentence pairs on MTEB Indic v1 · Bitext Mining in Assamese, Bengali, Dogri (macrolanguage), Goan Konkani, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu
F2LLM 4B—
F2LLM v2 4B78.1
MTEB Indic v1 · Classification · multilingual (8 languages) Embeddings assign examples to categories on MTEB Indic v1 · Classification in Bengali, Gujarati, Hindi, Malayalam, Nepali (macrolanguage), Panjabi, Sanskrit, Urdu
F2LLM 4B—
F2LLM v2 4B74.5
MTEB Indic v1 · Clustering · multilingual (21 languages) Embeddings group similar examples on MTEB Indic v1 · Clustering in Assamese, Awadhi, Bengali, Bhojpuri, Chhattisgarhi, Gujarati, Hindi, Kannada, Kashmiri, Maithili, Malayalam, Manipuri, Marathi, Nepali (individual language), Odia, Panjabi, Sanskrit, Sindhi, Tamil, Telugu, Urdu
F2LLM 4B—
F2LLM v2 4B87.4
MTEB Indic v1 · Pair Classification · Hindi Embeddings classify relationships between pairs on MTEB Indic v1 · Pair Classification in Hindi
F2LLM 4B—
F2LLM v2 4B73.9
MTEB Indic v1 · Reranking · multilingual (2 languages) Embeddings reorder candidate documents by relevance on MTEB Indic v1 · Reranking in Bengali, Hindi
F2LLM 4B—
F2LLM v2 4B87.7
MTEB Indic v1 · Retrieval · multilingual (14 languages) Embeddings rank relevant documents for queries on MTEB Indic v1 · Retrieval in Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Nepali (individual language), Odia, Panjabi, Sindhi, Tamil, Telugu, Urdu
F2LLM 4B—
F2LLM v2 4B89.1
MTEB Indic v1 · STS · multilingual (13 languages) Embeddings estimate semantic similarity between pairs on MTEB Indic v1 · STS in Assamese, Bengali, English, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Panjabi, Tamil, Telugu, Urdu
F2LLM 4B—
F2LLM v2 4B53.6
MTEB Korean v2 · Mean over tasks · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, rank relevant documents for queries, classify relationships between pairs, reorder candidate documents by relevance, assign examples to categories, group similar examples on MTEB Korean v2 · mean over tasks in English, Korean; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B74.9
MTEB Korean v2 · Mean over task types · multilingual (2 languages) Embeddings estimate semantic similarity between pairs, rank relevant documents for queries, classify relationships between pairs, reorder candidate documents by relevance, assign examples to categories, group similar examples on MTEB Korean v2 · mean over task types in English, Korean; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B72.4
MTEB Korean v2 · Classification · Korean Embeddings assign examples to categories on MTEB Korean v2 · Classification in Korean
F2LLM 4B—
F2LLM v2 4B66.3
MTEB Korean v2 · Clustering · Korean Embeddings group similar examples on MTEB Korean v2 · Clustering in Korean
F2LLM 4B—
F2LLM v2 4B80.5
MTEB Korean v2 · Pair Classification · Korean Embeddings classify relationships between pairs on MTEB Korean v2 · Pair Classification in Korean
F2LLM 4B—
F2LLM v2 4B66.1
MTEB Korean v2 · Reranking · Korean Embeddings reorder candidate documents by relevance on MTEB Korean v2 · Reranking in Korean
F2LLM 4B—
F2LLM v2 4B61.5
MTEB Korean v2 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Korean v2 · Retrieval in English, Korean
F2LLM 4B—
F2LLM v2 4B74.9
MTEB Korean v2 · STS · Korean Embeddings estimate semantic similarity between pairs on MTEB Korean v2 · STS in Korean
F2LLM 4B—
F2LLM v2 4B85.3
MTEB Law v1 · Mean over tasks · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over tasks in Chinese, English, German; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B61.5
MTEB Law v1 · Mean over task types · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · mean over task types in Chinese, English, German; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B61.5
MTEB Law v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Law v1 · Retrieval in Chinese, English, German
F2LLM 4B—
F2LLM v2 4B61.5
MTEB Medical v1 · Mean over tasks · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over tasks in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B64.5
MTEB Medical v1 · Mean over task types · multilingual (10 languages) Embeddings rank relevant documents for queries, group similar examples, reorder candidate documents by relevance on MTEB Medical v1 · mean over task types in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B67.8
MTEB Medical v1 · Reranking · Mandarin Chinese Embeddings reorder candidate documents by relevance on MTEB Medical v1 · Reranking in Mandarin Chinese
F2LLM 4B—
F2LLM v2 4B83.5
MTEB Medical v1 · Retrieval · multilingual (10 languages) Embeddings rank relevant documents for queries on MTEB Medical v1 · Retrieval in Arabic, Chinese, English, French, Korean, Mandarin Chinese, Polish, Russian, Spanish, Vietnamese
F2LLM 4B—
F2LLM v2 4B64.4
MTEB multilingual v2 · Mean over task types · multilingual (1037 languages) Embeddings assign examples to categories, group similar examples, estimate semantic similarity between pairs, classify relationships between pairs, rank relevant documents for queries, find translated sentence pairs, rerank documents according to instructions, assign multiple labels to each example, reorder candidate documents by relevance on MTEB Multilingual v2 · mean over task types in 1037 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B58.2
MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages) Embeddings find translated sentence pairs on MTEB Multilingual v2 · Bitext Mining in 1026 languages including 'Auhelawa, Abau, Achi, Achinese, Achuar-Shiwiar, Adzera, Afrikaans, Agarabi
F2LLM 4B—
F2LLM v2 4B74.5
MTEB multilingual v2 · Classification · multilingual (119 languages) Embeddings assign examples to categories on MTEB Multilingual v2 · Classification in 119 languages including Achinese, Afrikaans, Albanian, Algerian Arabic, Amharic, Arabic, Armenian, Assamese
F2LLM 4B—
F2LLM v2 4B70.7
MTEB multilingual v2 · Clustering · multilingual (208 languages) Embeddings group similar examples on MTEB Multilingual v2 · Clustering in 208 languages including Achinese, Afrikaans, Akan, Albanian, Amharic, Armenian, Assamese, Asturian
F2LLM 4B—
F2LLM v2 4B59.5
MTEB multilingual v2 · Instruction Reranking · English Embeddings rerank documents according to instructions on MTEB Multilingual v2 · Instruction Reranking in English
F2LLM 4B—
F2LLM v2 4B2.2
MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages) Embeddings assign multiple labels to each example on MTEB Multilingual v2 · Multilabel Classification in 25 languages including Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish
F2LLM 4B—
F2LLM v2 4B26.6
MTEB multilingual v2 · Pair Classification · multilingual (24 languages) Embeddings classify relationships between pairs on MTEB Multilingual v2 · Pair Classification in 24 languages including Arabic, Armenian, Bulgarian, Chinese, Czech, English, Finnish, French
F2LLM 4B—
F2LLM v2 4B80.5
MTEB multilingual v2 · Reranking · multilingual (22 languages) Embeddings reorder candidate documents by relevance on MTEB Multilingual v2 · Reranking in 22 languages including Bengali, Bulgarian, Czech, Danish, Dutch, English, Finnish, French
F2LLM 4B—
F2LLM v2 4B69.4
MTEB multilingual v2 · Retrieval · multilingual (120 languages) Embeddings rank relevant documents for queries on MTEB Multilingual v2 · Retrieval in 120 languages including Afrikaans, Amharic, Arabic, Armenian, Assamese, Bambara, Basque, Bengali
F2LLM 4B—
F2LLM v2 4B64.8
MTEB multilingual v2 · STS · multilingual (35 languages) Embeddings estimate semantic similarity between pairs on MTEB Multilingual v2 · STS in 35 languages including Afrikaans, Algerian Arabic, Amharic, Arabic, Assamese, Bengali, Dutch, English
F2LLM 4B—
F2LLM v2 4B75.9
MTEB Dutch v1 · Mean over tasks · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over tasks in Dutch; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B64.1
MTEB Dutch v1 · Mean over task types · Dutch Embeddings assign examples to categories, group similar examples, rank relevant documents for queries, estimate semantic similarity between pairs, assign multiple labels to each example, classify relationships between pairs, reorder candidate documents by relevance on MTEB Dutch v1 · mean over task types in Dutch; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B67.5
MTEB Dutch v1 · Classification · Dutch Embeddings assign examples to categories on MTEB Dutch v1 · Classification in Dutch
F2LLM 4B—
F2LLM v2 4B73
MTEB Dutch v1 · Clustering · Dutch Embeddings group similar examples on MTEB Dutch v1 · Clustering in Dutch
F2LLM 4B—
F2LLM v2 4B46.9
MTEB Dutch v1 · Multilabel Classification · Dutch Embeddings assign multiple labels to each example on MTEB Dutch v1 · Multilabel Classification in Dutch
F2LLM 4B—
F2LLM v2 4B40.7
MTEB Dutch v1 · Pair Classification · Dutch Embeddings classify relationships between pairs on MTEB Dutch v1 · Pair Classification in Dutch
F2LLM 4B—
F2LLM v2 4B76.9
MTEB Dutch v1 · Reranking · Dutch Embeddings reorder candidate documents by relevance on MTEB Dutch v1 · Reranking in Dutch
F2LLM 4B—
F2LLM v2 4B88.6
MTEB Dutch v1 · Retrieval · Dutch Embeddings rank relevant documents for queries on MTEB Dutch v1 · Retrieval in Dutch
F2LLM 4B—
F2LLM v2 4B65.4
MTEB Dutch v1 · STS · Dutch Embeddings estimate semantic similarity between pairs on MTEB Dutch v1 · STS in Dutch
F2LLM 4B—
F2LLM v2 4B80.9
MTEB Polish v1 · Mean over tasks · Polish Embeddings classify relationships between pairs, assign examples to categories, estimate semantic similarity between pairs, group similar examples on MTEB Polish v1 · mean over tasks in Polish; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B73.4
MTEB Polish v1 · Mean over task types · Polish Embeddings classify relationships between pairs, assign examples to categories, estimate semantic similarity between pairs, group similar examples on MTEB Polish v1 · mean over task types in Polish; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B70.3
MTEB Polish v1 · Classification · Polish Embeddings assign examples to categories on MTEB Polish v1 · Classification in Polish
F2LLM 4B—
F2LLM v2 4B80.2
MTEB Polish v1 · Clustering · Polish Embeddings group similar examples on MTEB Polish v1 · Clustering in Polish
F2LLM 4B—
F2LLM v2 4B47.3
MTEB Polish v1 · Pair Classification · Polish Embeddings classify relationships between pairs on MTEB Polish v1 · Pair Classification in Polish
F2LLM 4B—
F2LLM v2 4B83.8
MTEB Polish v1 · STS · Polish Embeddings estimate semantic similarity between pairs on MTEB Polish v1 · STS in Polish
F2LLM 4B—
F2LLM v2 4B69.8
MTEB Portuguese v1 · Multilabel Classification · Portuguese Embeddings assign multiple labels to each example on MTEB Portuguese v1 · Multilabel Classification in Portuguese
F2LLM 4B—
F2LLM v2 4B22.3
MTEB Russian v1.1 · Mean over tasks · Russian Embeddings assign examples to categories, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, rank relevant documents for queries, assign multiple labels to each example on MTEB Russian v1.1 · mean over tasks in Russian; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B69.5
MTEB Russian v1.1 · Mean over task types · Russian Embeddings assign examples to categories, estimate semantic similarity between pairs, reorder candidate documents by relevance, group similar examples, classify relationships between pairs, rank relevant documents for queries, assign multiple labels to each example on MTEB Russian v1.1 · mean over task types in Russian; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B65.9
MTEB Russian v1.1 · Classification · Russian Embeddings assign examples to categories on MTEB Russian v1.1 · Classification in Russian
F2LLM 4B—
F2LLM v2 4B75.1
MTEB Russian v1.1 · Clustering · Russian Embeddings group similar examples on MTEB Russian v1.1 · Clustering in Russian
F2LLM 4B—
F2LLM v2 4B63.9
MTEB Russian v1.1 · Multilabel Classification · Russian Embeddings assign multiple labels to each example on MTEB Russian v1.1 · Multilabel Classification in Russian
F2LLM 4B—
F2LLM v2 4B44.8
MTEB Russian v1.1 · Pair Classification · Russian Embeddings classify relationships between pairs on MTEB Russian v1.1 · Pair Classification in Russian
F2LLM 4B—
F2LLM v2 4B61.1
MTEB Russian v1.1 · Reranking · Russian Embeddings reorder candidate documents by relevance on MTEB Russian v1.1 · Reranking in Russian
F2LLM 4B—
F2LLM v2 4B69.1
MTEB Russian v1.1 · Retrieval · Russian Embeddings rank relevant documents for queries on MTEB Russian v1.1 · Retrieval in Russian
F2LLM 4B—
F2LLM v2 4B73.7
MTEB Russian v1.1 · STS · Russian Embeddings estimate semantic similarity between pairs on MTEB Russian v1.1 · STS in Russian
F2LLM 4B—
F2LLM v2 4B73.3
MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages) Embeddings group similar examples, assign examples to categories, rank relevant documents for queries, find translated sentence pairs on MTEB Scandinavian v1 · mean over tasks in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B68.5
MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages) Embeddings group similar examples, assign examples to categories, rank relevant documents for queries, find translated sentence pairs on MTEB Scandinavian v1 · mean over task types in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B67.3
MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages) Embeddings find translated sentence pairs on MTEB Scandinavian v1 · Bitext Mining in Danish, Norwegian Bokmål, Norwegian Nynorsk
F2LLM 4B—
F2LLM v2 4B72.2
MTEB Scandinavian v1 · Classification · multilingual (6 languages) Embeddings assign examples to categories on MTEB Scandinavian v1 · Classification in Danish, Faroese, Icelandic, Norwegian Bokmål, Norwegian Nynorsk, Swedish
F2LLM 4B—
F2LLM v2 4B73.9
MTEB Scandinavian v1 · Clustering · multilingual (2 languages) Embeddings group similar examples on MTEB Scandinavian v1 · Clustering in Norwegian Bokmål, Swedish
F2LLM 4B—
F2LLM v2 4B50.7
MTEB Scandinavian v1 · Retrieval · multilingual (3 languages) Embeddings rank relevant documents for queries on MTEB Scandinavian v1 · Retrieval in Danish, Norwegian Bokmål, Swedish
F2LLM 4B—
F2LLM v2 4B72.6
MTEB Spanish v1 · Mean over tasks · multilingual (2 languages) Embeddings classify relationships between pairs, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over tasks in English, Spanish; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B72.5
MTEB Spanish v1 · Mean over task types · multilingual (2 languages) Embeddings classify relationships between pairs, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, assign examples to categories on MTEB Spanish v1 · mean over task types in English, Spanish; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B73.9
MTEB Spanish v1 · Classification · Spanish Embeddings assign examples to categories on MTEB Spanish v1 · Classification in Spanish
F2LLM 4B—
F2LLM v2 4B94.5
MTEB Spanish v1 · Clustering · Spanish Embeddings group similar examples on MTEB Spanish v1 · Clustering in Spanish
F2LLM 4B—
F2LLM v2 4B77.6
MTEB Spanish v1 · Pair Classification · Spanish Embeddings classify relationships between pairs on MTEB Spanish v1 · Pair Classification in Spanish
F2LLM 4B—
F2LLM v2 4B72.3
MTEB Spanish v1 · Reranking · Spanish Embeddings reorder candidate documents by relevance on MTEB Spanish v1 · Reranking in Spanish
F2LLM 4B—
F2LLM v2 4B61.3
MTEB Spanish v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Spanish v1 · Retrieval in English, Spanish
F2LLM 4B—
F2LLM v2 4B58.6
MTEB Spanish v1 · STS · multilingual (2 languages) Embeddings estimate semantic similarity between pairs on MTEB Spanish v1 · STS in English, Spanish
F2LLM 4B—
F2LLM v2 4B79.3
MTEB Thai v1 · Mean over tasks · multilingual (2 languages) Embeddings group similar examples, assign examples to categories, classify relationships between pairs, rank relevant documents for queries, reorder candidate documents by relevance on MTEB Thai v1 · mean over tasks in English, Thai; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B76.9
MTEB Thai v1 · Mean over task types · multilingual (2 languages) Embeddings group similar examples, assign examples to categories, classify relationships between pairs, rank relevant documents for queries, reorder candidate documents by relevance on MTEB Thai v1 · mean over task types in English, Thai; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B80.5
MTEB Thai v1 · Classification · Thai Embeddings assign examples to categories on MTEB Thai v1 · Classification in Thai
F2LLM 4B—
F2LLM v2 4B82.7
MTEB Thai v1 · Clustering · Thai Embeddings group similar examples on MTEB Thai v1 · Clustering in Thai
F2LLM 4B—
F2LLM v2 4B91.3
MTEB Thai v1 · Pair Classification · Thai Embeddings classify relationships between pairs on MTEB Thai v1 · Pair Classification in Thai
F2LLM 4B—
F2LLM v2 4B75.3
MTEB Thai v1 · Reranking · Thai Embeddings reorder candidate documents by relevance on MTEB Thai v1 · Reranking in Thai
F2LLM 4B—
F2LLM v2 4B83
MTEB Thai v1 · Retrieval · multilingual (2 languages) Embeddings rank relevant documents for queries on MTEB Thai v1 · Retrieval in English, Thai
F2LLM 4B—
F2LLM v2 4B69.9
RTEB German beta · Mean over tasks · German Embeddings rank relevant documents for queries on RTEB German Beta · mean over tasks in German; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B62.3
RTEB Finnish beta · Mean over tasks · English Embeddings rank relevant documents for queries on RTEB Finnish Beta · mean over tasks in English; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B73.9
RTEB French beta · Mean over tasks · multilingual (2 languages) Embeddings rank relevant documents for queries on RTEB French Beta · mean over tasks in English, French; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B50.3
RTEB Health beta · Mean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Health Beta · mean over tasks in English, French, German, Spanish; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B65.5
RTEB Law beta · Mean over tasks · multilingual (4 languages) Embeddings rank relevant documents for queries on RTEB Law Beta · mean over tasks in English, French, German, Japanese; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B52.7
VN-MTEB Vietnamese v1 · Mean over tasks · Vietnamese Embeddings assign examples to categories, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, classify relationships between pairs on Vn MTEB Vietnamese v1 · mean over tasks in Vietnamese; tasks receive equal weight
F2LLM 4B—
F2LLM v2 4B62.7
VN-MTEB Vietnamese v1 · Mean over task types · Vietnamese Embeddings assign examples to categories, estimate semantic similarity between pairs, rank relevant documents for queries, group similar examples, reorder candidate documents by relevance, classify relationships between pairs on Vn MTEB Vietnamese v1 · mean over task types in Vietnamese; task types receive equal weight
F2LLM 4B—
F2LLM v2 4B71
VN-MTEB Vietnamese v1 · Classification · Vietnamese Embeddings assign examples to categories on Vn MTEB Vietnamese v1 · Classification in Vietnamese
F2LLM 4B—
F2LLM v2 4B85.1
VN-MTEB Vietnamese v1 · Clustering · Vietnamese Embeddings group similar examples on Vn MTEB Vietnamese v1 · Clustering in Vietnamese
F2LLM 4B—
F2LLM v2 4B58.1
VN-MTEB Vietnamese v1 · Pair Classification · Vietnamese Embeddings classify relationships between pairs on Vn MTEB Vietnamese v1 · Pair Classification in Vietnamese
F2LLM 4B—
F2LLM v2 4B84.5
VN-MTEB Vietnamese v1 · Reranking · Vietnamese Embeddings reorder candidate documents by relevance on Vn MTEB Vietnamese v1 · Reranking in Vietnamese
F2LLM 4B—
F2LLM v2 4B69.4
VN-MTEB Vietnamese v1 · Retrieval · Vietnamese Embeddings rank relevant documents for queries on Vn MTEB Vietnamese v1 · Retrieval in Vietnamese
F2LLM 4B—
F2LLM v2 4B46.5
VN-MTEB Vietnamese v1 · STS · Vietnamese Embeddings estimate semantic similarity between pairs on Vn MTEB Vietnamese v1 · STS in Vietnamese
F2LLM 4B—
F2LLM v2 4B82.6
| Benchmark | F2LLM 4B | F2LLM v2 4B |
|---|---|---|
| MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages) | — | 67.1 |
| MTEB Medical v1 · Clustering · English | 71.1 | 55.5 |
| MTEB English v2 · Pair Classification · English | 83.8 | 85.1 |
| MTEB English v2 · Classification · English | 91.7 | 91.7 |
| MTEB English v2 · Reranking · English | 50 | 50.1 |
| MTEB English v2 · STS · English | 84.2 | 84.2 |
| MTEB English v2 · Retrieval · English | 59.6 | 59.1 |
| MTEB English v2 · Clustering · English | 68.5 | 62 |
| MTEB English v2 · Summarization · English | 33.2 | 34.5 |
| BEIR · Mean over tasks · English | — | 56.9 |
| BEIR · Mean over task types · English | — | 56.9 |
| BEIR · Retrieval · English | — | 56.9 |
| BRIGHT · Mean over tasks · English | — | 16.4 |
| BRIGHT · Mean over task types · English | — | 16.4 |
| BRIGHT · Retrieval · English | — | 16.4 |
| ChemTEB · Mean over tasks · multilingual (13 languages) | — | 76.5 |
| ChemTEB · Mean over task types · multilingual (13 languages) | — | 56.7 |
| ChemTEB · Bitext Mining · English | — | 1.6 |
| ChemTEB · Classification · English | — | 85.1 |
| ChemTEB · Clustering · English | — | 46.5 |
| ChemTEB · Pair Classification · multilingual (13 languages) | — | 73.9 |
| ChemTEB · Retrieval · English | — | 76.5 |
| CoIR · Mean over tasks · multilingual (9 languages) | — | 79.6 |
| CoIR · Mean over task types · multilingual (9 languages) | — | 79.6 |
| CoIR · Retrieval · multilingual (9 languages) | — | 79.6 |
| CoREB v1 · Mean over tasks · multilingual (6 languages) | — | 59.5 |
| CoREB v1 · Mean over task types · multilingual (6 languages) | — | 59.5 |
| CoREB v1 · Reranking · multilingual (6 languages) | — | 54.3 |
| CoREB v1 · Retrieval · multilingual (6 languages) | — | 64.7 |
| FollowIR · Mean over tasks · English | — | 2.2 |
| FollowIR · Mean over task types · English | — | 2.2 |
| FollowIR · Instruction Reranking · English | — | 2.2 |
| JMTEB v2 · Mean over tasks · Japanese | — | 77.4 |
| JMTEB v2 · Mean over task types · Japanese | — | 77.6 |
| JMTEB v2 · Classification · Japanese | — | 80.4 |
| JMTEB v2 · Clustering · Japanese | — | 70.5 |
| JMTEB v2 · Reranking · Japanese | — | 75.4 |
| JMTEB v2 · Retrieval · Japanese | — | 77 |
| JMTEB v2 · STS · Japanese | — | 84.7 |
| LongEmbed · Mean over tasks · English | — | 75.4 |
| LongEmbed · Mean over task types · English | — | 75.4 |
| LongEmbed · Retrieval · English | — | 75.4 |
| MTEB Mandarin Chinese v1 · Mean over tasks · Mandarin Chinese | — | 67.1 |
| MTEB Mandarin Chinese v1 · Mean over task types · Mandarin Chinese | — | 67.4 |
| MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese | — | 76.5 |
| MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese | — | 70.3 |
| MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese | — | 67 |
| MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese | — | 66.8 |
| MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese | — | 72.7 |
| MTEB Mandarin Chinese v1 · STS · Mandarin Chinese | — | 51.2 |
| MTEB Code v1 · Mean over tasks · multilingual (15 languages) | — | 80.2 |
| MTEB Code v1 · Mean over task types · multilingual (15 languages) | — | 80.2 |
| MTEB Code v1 · Retrieval · multilingual (15 languages) | — | 80.2 |
| MTEB German v1 · Mean over tasks · German | — | 66.1 |
| MTEB German v1 · Mean over task types · German | — | 62.5 |
| MTEB German v1 · Classification · German | — | 88.4 |
| MTEB German v1 · Clustering · German | — | 43.7 |
| MTEB German v1 · Pair Classification · German | — | 59 |
| MTEB German v1 · Reranking · German | — | 51.7 |
| MTEB German v1 · Retrieval · German | — | 58 |
| MTEB German v1 · STS · German | — | 74.2 |
| MTEB Europe v1 · Mean over tasks · multilingual (29 languages) | — | 68.6 |
| MTEB Europe v1 · Mean over task types · multilingual (29 languages) | — | 59.9 |
| MTEB Europe v1 · Bitext Mining · multilingual (28 languages) | — | 89.6 |
| MTEB Europe v1 · Classification · multilingual (23 languages) | — | 74.2 |
| MTEB Europe v1 · Clustering · multilingual (29 languages) | — | 56.4 |
| MTEB Europe v1 · Instruction Reranking · English | — | 2.2 |
| MTEB Europe v1 · Multilabel Classification · multilingual (23 languages) | — | 22.3 |
| MTEB Europe v1 · Pair Classification · multilingual (11 languages) | — | 89.2 |
| MTEB Europe v1 · Reranking · multilingual (12 languages) | — | 63.7 |
| MTEB Europe v1 · Retrieval · multilingual (25 languages) | — | 65.7 |
| MTEB Europe v1 · STS · multilingual (8 languages) | — | 76 |
| MTEB Persian v2 · Mean over tasks · Persian | — | 72.1 |
| MTEB Persian v2 · Mean over task types · Persian | — | 74.3 |
| MTEB Persian v2 · Bitext Mining · Persian | — | 77.1 |
| MTEB Persian v2 · Classification · Persian | — | 74 |
| MTEB Persian v2 · Clustering · Persian | — | 67.5 |
| MTEB Persian v2 · Pair Classification · Persian | — | 86.4 |
| MTEB Persian v2 · Reranking · Persian | — | 72.5 |
| MTEB Persian v2 · Retrieval · Persian | — | 64 |
| MTEB Persian v2 · STS · Persian | — | 79 |
| MTEB French v1 · Mean over tasks · multilingual (2 languages) | — | 71.2 |
| MTEB French v1 · Mean over task types · multilingual (2 languages) | — | 69 |
| MTEB French v1 · Classification · French | — | 85.3 |
| MTEB French v1 · Clustering · French | — | 56.9 |
| MTEB French v1 · Pair Classification · French | — | 70.1 |
| MTEB French v1 · Reranking · French | — | 86.6 |
| MTEB French v1 · Retrieval · multilingual (2 languages) | — | 69.1 |
| MTEB French v1 · STS · French | — | 83.5 |
| MTEB French v1 · Summarization · French | — | 31.4 |
| MTEB Indic v1 · Mean over tasks · multilingual (25 languages) | — | 76.6 |
| MTEB Indic v1 · Mean over task types · multilingual (25 languages) | — | 77.8 |
| MTEB Indic v1 · Bitext Mining · multilingual (20 languages) | — | 78.1 |
| MTEB Indic v1 · Classification · multilingual (8 languages) | — | 74.5 |
| MTEB Indic v1 · Clustering · multilingual (21 languages) | — | 87.4 |
| MTEB Indic v1 · Pair Classification · Hindi | — | 73.9 |
| MTEB Indic v1 · Reranking · multilingual (2 languages) | — | 87.7 |
| MTEB Indic v1 · Retrieval · multilingual (14 languages) | — | 89.1 |
| MTEB Indic v1 · STS · multilingual (13 languages) | — | 53.6 |
| MTEB Korean v2 · Mean over tasks · multilingual (2 languages) | — | 74.9 |
| MTEB Korean v2 · Mean over task types · multilingual (2 languages) | — | 72.4 |
| MTEB Korean v2 · Classification · Korean | — | 66.3 |
| MTEB Korean v2 · Clustering · Korean | — | 80.5 |
| MTEB Korean v2 · Pair Classification · Korean | — | 66.1 |
| MTEB Korean v2 · Reranking · Korean | — | 61.5 |
| MTEB Korean v2 · Retrieval · multilingual (2 languages) | — | 74.9 |
| MTEB Korean v2 · STS · Korean | — | 85.3 |
| MTEB Law v1 · Mean over tasks · multilingual (3 languages) | — | 61.5 |
| MTEB Law v1 · Mean over task types · multilingual (3 languages) | — | 61.5 |
| MTEB Law v1 · Retrieval · multilingual (3 languages) | — | 61.5 |
| MTEB Medical v1 · Mean over tasks · multilingual (10 languages) | — | 64.5 |
| MTEB Medical v1 · Mean over task types · multilingual (10 languages) | — | 67.8 |
| MTEB Medical v1 · Reranking · Mandarin Chinese | — | 83.5 |
| MTEB Medical v1 · Retrieval · multilingual (10 languages) | — | 64.4 |
| MTEB multilingual v2 · Mean over task types · multilingual (1037 languages) | — | 58.2 |
| MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages) | — | 74.5 |
| MTEB multilingual v2 · Classification · multilingual (119 languages) | — | 70.7 |
| MTEB multilingual v2 · Clustering · multilingual (208 languages) | — | 59.5 |
| MTEB multilingual v2 · Instruction Reranking · English | — | 2.2 |
| MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages) | — | 26.6 |
| MTEB multilingual v2 · Pair Classification · multilingual (24 languages) | — | 80.5 |
| MTEB multilingual v2 · Reranking · multilingual (22 languages) | — | 69.4 |
| MTEB multilingual v2 · Retrieval · multilingual (120 languages) | — | 64.8 |
| MTEB multilingual v2 · STS · multilingual (35 languages) | — | 75.9 |
| MTEB Dutch v1 · Mean over tasks · Dutch | — | 64.1 |
| MTEB Dutch v1 · Mean over task types · Dutch | — | 67.5 |
| MTEB Dutch v1 · Classification · Dutch | — | 73 |
| MTEB Dutch v1 · Clustering · Dutch | — | 46.9 |
| MTEB Dutch v1 · Multilabel Classification · Dutch | — | 40.7 |
| MTEB Dutch v1 · Pair Classification · Dutch | — | 76.9 |
| MTEB Dutch v1 · Reranking · Dutch | — | 88.6 |
| MTEB Dutch v1 · Retrieval · Dutch | — | 65.4 |
| MTEB Dutch v1 · STS · Dutch | — | 80.9 |
| MTEB Polish v1 · Mean over tasks · Polish | — | 73.4 |
| MTEB Polish v1 · Mean over task types · Polish | — | 70.3 |
| MTEB Polish v1 · Classification · Polish | — | 80.2 |
| MTEB Polish v1 · Clustering · Polish | — | 47.3 |
| MTEB Polish v1 · Pair Classification · Polish | — | 83.8 |
| MTEB Polish v1 · STS · Polish | — | 69.8 |
| MTEB Portuguese v1 · Multilabel Classification · Portuguese | — | 22.3 |
| MTEB Russian v1.1 · Mean over tasks · Russian | — | 69.5 |
| MTEB Russian v1.1 · Mean over task types · Russian | — | 65.9 |
| MTEB Russian v1.1 · Classification · Russian | — | 75.1 |
| MTEB Russian v1.1 · Clustering · Russian | — | 63.9 |
| MTEB Russian v1.1 · Multilabel Classification · Russian | — | 44.8 |
| MTEB Russian v1.1 · Pair Classification · Russian | — | 61.1 |
| MTEB Russian v1.1 · Reranking · Russian | — | 69.1 |
| MTEB Russian v1.1 · Retrieval · Russian | — | 73.7 |
| MTEB Russian v1.1 · STS · Russian | — | 73.3 |
| MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages) | — | 68.5 |
| MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages) | — | 67.3 |
| MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages) | — | 72.2 |
| MTEB Scandinavian v1 · Classification · multilingual (6 languages) | — | 73.9 |
| MTEB Scandinavian v1 · Clustering · multilingual (2 languages) | — | 50.7 |
| MTEB Scandinavian v1 · Retrieval · multilingual (3 languages) | — | 72.6 |
| MTEB Spanish v1 · Mean over tasks · multilingual (2 languages) | — | 72.5 |
| MTEB Spanish v1 · Mean over task types · multilingual (2 languages) | — | 73.9 |
| MTEB Spanish v1 · Classification · Spanish | — | 94.5 |
| MTEB Spanish v1 · Clustering · Spanish | — | 77.6 |
| MTEB Spanish v1 · Pair Classification · Spanish | — | 72.3 |
| MTEB Spanish v1 · Reranking · Spanish | — | 61.3 |
| MTEB Spanish v1 · Retrieval · multilingual (2 languages) | — | 58.6 |
| MTEB Spanish v1 · STS · multilingual (2 languages) | — | 79.3 |
| MTEB Thai v1 · Mean over tasks · multilingual (2 languages) | — | 76.9 |
| MTEB Thai v1 · Mean over task types · multilingual (2 languages) | — | 80.5 |
| MTEB Thai v1 · Classification · Thai | — | 82.7 |
| MTEB Thai v1 · Clustering · Thai | — | 91.3 |
| MTEB Thai v1 · Pair Classification · Thai | — | 75.3 |
| MTEB Thai v1 · Reranking · Thai | — | 83 |
| MTEB Thai v1 · Retrieval · multilingual (2 languages) | — | 69.9 |
| RTEB German beta · Mean over tasks · German | — | 62.3 |
| RTEB Finnish beta · Mean over tasks · English | — | 73.9 |
| RTEB French beta · Mean over tasks · multilingual (2 languages) | — | 50.3 |
| RTEB Health beta · Mean over tasks · multilingual (4 languages) | — | 65.5 |
| RTEB Law beta · Mean over tasks · multilingual (4 languages) | — | 52.7 |
| VN-MTEB Vietnamese v1 · Mean over tasks · Vietnamese | — | 62.7 |
| VN-MTEB Vietnamese v1 · Mean over task types · Vietnamese | — | 71 |
| VN-MTEB Vietnamese v1 · Classification · Vietnamese | — | 85.1 |
| VN-MTEB Vietnamese v1 · Clustering · Vietnamese | — | 58.1 |
| VN-MTEB Vietnamese v1 · Pair Classification · Vietnamese | — | 84.5 |
| VN-MTEB Vietnamese v1 · Reranking · Vietnamese | — | 69.4 |
| VN-MTEB Vietnamese v1 · Retrieval · Vietnamese | — | 46.5 |
| VN-MTEB Vietnamese v1 · STS · Vietnamese | — | 82.6 |
Specs
| Spec | F2LLM 4B | F2LLM v2 4B |
|---|---|---|
| Context | 8K | 41K |
| Weights | Open | Open |
| Released | Sep 2025 | Mar 2026 |
| Dimensions | 2,560 | 2,560 |
| Max input | 41K tokens | 41K tokens |
| Languages | en | en, es, Estonian +80 |
| Memory (4-bit) | 2.4 GB | 2.4 GB |
| Licence | Apache-2.0 | Apache-2.0 |
| Commercial use | Allowed | Allowed |
What breaks when you switch
F2LLM 4B → F2LLM v2 4B
Re-embed your whole corpus›
Vectors from different models can't be mixed.
F2LLM v2 4B → F2LLM 4B
Re-embed your whole corpus›
Vectors from different models can't be mixed.