Harrier OSS v1 27B vs Qwen 3 Embedding 4B
Harrier OSS v1 27B74.3
Qwen 3 Embedding 4B69.4
Harrier OSS v1 27B93.6
Qwen 3 Embedding 4B92.2
Harrier OSS v1 27B52.8
Qwen 3 Embedding 4B50.4
Harrier OSS v1 27B26
Qwen 3 Embedding 4B23.6
Harrier OSS v1 27B64.4
Qwen 3 Embedding 4B62
Harrier OSS v1 27B55
Qwen 3 Embedding 4B49.7
Harrier OSS v1 27B86.8
Qwen 3 Embedding 4B85.8
Harrier OSS v1 27B76.6
Qwen 3 Embedding 4B77.1
Harrier OSS v1 27B64.2
Qwen 3 Embedding 4B60.9
Harrier OSS v1 27B86
Qwen 3 Embedding 4B79.4
Harrier OSS v1 27B79.9
Qwen 3 Embedding 4B72.3
Harrier OSS v1 27B58.9
Qwen 3 Embedding 4B57.1
Harrier OSS v1 27B36.4
Qwen 3 Embedding 4B26.8
Harrier OSS v1 27B85.4
Qwen 3 Embedding 4B85.1
Harrier OSS v1 27B67.3
Qwen 3 Embedding 4B65.1
Harrier OSS v1 27B78.3
Qwen 3 Embedding 4B69.6
Harrier OSS v1 27B80
Qwen 3 Embedding 4B80.9
Harrier OSS v1 27B38.1
Qwen 3 Embedding 4B20.6
Harrier OSS v1 27B85
Qwen 3 Embedding 4B82.2
Harrier OSS v1 27B—
Qwen 3 Embedding 4B64.8
Harrier OSS v1 27B—
Qwen 3 Embedding 4B56.5
Harrier OSS v1 27B—
Qwen 3 Embedding 4B72.3
Harrier OSS v1 27B—
Qwen 3 Embedding 4B73.5
Harrier OSS v1 27B—
Qwen 3 Embedding 4B75.5
Harrier OSS v1 27B—
Qwen 3 Embedding 4B83.3
Harrier OSS v1 27B—
Qwen 3 Embedding 4B80.1
Harrier OSS v1 27B—
Qwen 3 Embedding 4B80.1
Harrier OSS v1 27B—
Qwen 3 Embedding 4B69
Harrier OSS v1 27B—
Qwen 3 Embedding 4B61.3
Harrier OSS v1 27B—
Qwen 3 Embedding 4B72.3
Harrier OSS v1 27B—
Qwen 3 Embedding 4B93
Harrier OSS v1 27B—
Qwen 3 Embedding 4B70.7
Harrier OSS v1 27B—
Qwen 3 Embedding 4B76.8
Harrier OSS v1 27B—
Qwen 3 Embedding 4B74.6
Harrier OSS v1 27B—
Qwen 3 Embedding 4B68.6
Harrier OSS v1 27B—
Qwen 3 Embedding 4B69.6
Harrier OSS v1 27B—
Qwen 3 Embedding 4B72.9
Harrier OSS v1 27B—
Qwen 3 Embedding 4B54.9
Harrier OSS v1 27B—
Qwen 3 Embedding 4B68.4
Harrier OSS v1 27B—
Qwen 3 Embedding 4B63.5
| Benchmark | Harrier OSS v1 27B | Qwen 3 Embedding 4B |
|---|---|---|
| MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages) | 74.3 | 69.4 |
| FollowIR · Mean over tasks · English | 5.4 | 11.6 |
| FollowIR · Mean over task types · English | 5.4 | 11.6 |
| FollowIR · Instruction Reranking · English | 5.4 | 11.6 |
| MTEB Europe v1 · Bitext Mining · multilingual (28 languages) | 93.6 | 92.2 |
| MTEB Europe v1 · Clustering · multilingual (29 languages) | 52.8 | 50.4 |
| MTEB Europe v1 · Instruction Reranking · English | 5.4 | 11.6 |
| MTEB Europe v1 · Multilabel Classification · multilingual (23 languages) | 26 | 23.6 |
| MTEB Europe v1 · Reranking · multilingual (12 languages) | 64.4 | 62 |
| MTEB French v1 · Pair Classification · French | 72.4 | 72.6 |
| MTEB Indic v1 · Clustering · multilingual (21 languages) | 55 | 49.7 |
| MTEB Indic v1 · Pair Classification · Hindi | 87.6 | 85.6 |
| MTEB Indic v1 · Reranking · multilingual (2 languages) | 86.8 | 85.8 |
| MTEB Indic v1 · STS · multilingual (13 languages) | 63.4 | 60.8 |
| MTEB Korean v2 · Retrieval · multilingual (2 languages) | 76.6 | 77.1 |
| MTEB multilingual v2 · Mean over task types · multilingual (1037 languages) | 64.2 | 60.9 |
| MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages) | 86 | 79.4 |
| MTEB multilingual v2 · Classification · multilingual (119 languages) | 79.9 | 72.3 |
| MTEB multilingual v2 · Clustering · multilingual (208 languages) | 58.9 | 57.1 |
| MTEB multilingual v2 · Instruction Reranking · English | 5.4 | 11.6 |
| MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages) | 36.4 | 26.8 |
| MTEB multilingual v2 · Pair Classification · multilingual (24 languages) | 85.4 | 85.1 |
| MTEB multilingual v2 · Reranking · multilingual (22 languages) | 67.3 | 65.1 |
| MTEB multilingual v2 · Retrieval · multilingual (120 languages) | 78.3 | 69.6 |
| MTEB multilingual v2 · STS · multilingual (35 languages) | 80 | 80.9 |
| MTEB Dutch v1 · Reranking · Dutch | 90.9 | 89.1 |
| MTEB Portuguese v1 · Multilabel Classification · Portuguese | 38.1 | 20.6 |
| MTEB Russian v1.1 · Pair Classification · Russian | 61.5 | 66.6 |
| MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages) | 85 | 82.2 |
| MTEB Spanish v1 · Pair Classification · Spanish | 81.2 | 80.1 |
| MTEB Thai v1 · Clustering · Thai | 55.3 | 54.3 |
| MTEB Thai v1 · Pair Classification · Thai | 88.5 | 86.7 |
| BEIR · Mean over tasks · English | — | 61.6 |
| BEIR · Mean over task types · English | — | 61.6 |
| BEIR · Retrieval · English | — | 61.6 |
| ChemTEB · Bitext Mining · English | — | 0.3 |
| ChemTEB · Clustering · English | — | 41.2 |
| ChemTEB · Pair Classification · multilingual (13 languages) | — | 64.8 |
| ChemTEB · Retrieval · English | — | 74 |
| CoIR · Mean over tasks · multilingual (9 languages) | — | 79.2 |
| CoIR · Mean over task types · multilingual (9 languages) | — | 79.2 |
| CoIR · Retrieval · multilingual (9 languages) | — | 79.2 |
| CoREB v1 · Mean over tasks · multilingual (6 languages) | — | 56.5 |
| CoREB v1 · Mean over task types · multilingual (6 languages) | — | 56.5 |
| CoREB v1 · Reranking · multilingual (6 languages) | — | 52.3 |
| CoREB v1 · Retrieval · multilingual (6 languages) | — | 60.6 |
| JMTEB v2 · Clustering · Japanese | — | 53.4 |
| JMTEB v2 · STS · Japanese | — | 87.3 |
| MTEB Mandarin Chinese v1 · Mean over tasks · Mandarin Chinese | — | 72.3 |
| MTEB Mandarin Chinese v1 · Mean over task types · Mandarin Chinese | — | 73.5 |
| MTEB Mandarin Chinese v1 · Classification · Mandarin Chinese | — | 75.5 |
| MTEB Mandarin Chinese v1 · Clustering · Mandarin Chinese | — | 77.9 |
| MTEB Mandarin Chinese v1 · Pair Classification · Mandarin Chinese | — | 83.3 |
| MTEB Mandarin Chinese v1 · Reranking · Mandarin Chinese | — | 66.1 |
| MTEB Mandarin Chinese v1 · Retrieval · Mandarin Chinese | — | 77 |
| MTEB Mandarin Chinese v1 · STS · Mandarin Chinese | — | 61.3 |
| MTEB Code v1 · Mean over tasks · multilingual (15 languages) | — | 80.1 |
| MTEB Code v1 · Mean over task types · multilingual (15 languages) | — | 80.1 |
| MTEB Code v1 · Retrieval · multilingual (15 languages) | — | 80.1 |
| MTEB German v1 · Pair Classification · German | — | 61.8 |
| MTEB German v1 · STS · German | — | 79 |
| MTEB Europe v1 · Mean over tasks · multilingual (29 languages) | — | 69 |
| MTEB Europe v1 · Mean over task types · multilingual (29 languages) | — | 61.3 |
| MTEB Europe v1 · Classification · multilingual (23 languages) | — | 72.3 |
| MTEB Europe v1 · Pair Classification · multilingual (11 languages) | — | 93 |
| MTEB Europe v1 · Retrieval · multilingual (25 languages) | — | 65.6 |
| MTEB Europe v1 · STS · multilingual (8 languages) | — | 81.2 |
| MTEB Persian v2 · Bitext Mining · Persian | — | 61.3 |
| MTEB Persian v2 · Clustering · Persian | — | 68.1 |
| MTEB Persian v2 · STS · Persian | — | 81.7 |
| MTEB French v1 · Reranking · French | — | 88.6 |
| MTEB French v1 · Retrieval · multilingual (2 languages) | — | 68.5 |
| MTEB French v1 · STS · French | — | 86.2 |
| MTEB French v1 · Summarization · French | — | 31.3 |
| MTEB Indic v1 · Classification · multilingual (8 languages) | — | 70.7 |
| MTEB Indic v1 · Retrieval · multilingual (14 languages) | — | 90.3 |
| MTEB Korean v2 · Mean over tasks · multilingual (2 languages) | — | 76.8 |
| MTEB Korean v2 · Mean over task types · multilingual (2 languages) | — | 74.6 |
| MTEB Korean v2 · Classification · Korean | — | 67.4 |
| MTEB Korean v2 · Clustering · Korean | — | 70.9 |
| MTEB Korean v2 · Pair Classification · Korean | — | 75.3 |
| MTEB Korean v2 · Reranking · Korean | — | 67.3 |
| MTEB Korean v2 · STS · Korean | — | 89.9 |
| MTEB Medical v1 · Clustering · English | — | 44.6 |
| MTEB Medical v1 · Reranking · Mandarin Chinese | — | 85.1 |
| MTEB Dutch v1 · Mean over tasks · Dutch | — | 63.7 |
| MTEB Dutch v1 · Mean over task types · Dutch | — | 68.5 |
| MTEB Dutch v1 · Classification · Dutch | — | 70.7 |
| MTEB Dutch v1 · Clustering · Dutch | — | 46.5 |
| MTEB Dutch v1 · Multilabel Classification · Dutch | — | 40.2 |
| MTEB Dutch v1 · Pair Classification · Dutch | — | 81.5 |
| MTEB Dutch v1 · Retrieval · Dutch | — | 65.1 |
| MTEB Dutch v1 · STS · Dutch | — | 86.1 |
| MTEB Polish v1 · Mean over tasks · Polish | — | 72.3 |
| MTEB Polish v1 · Mean over task types · Polish | — | 70.5 |
| MTEB Polish v1 · Classification · Polish | — | 74.1 |
| MTEB Polish v1 · Clustering · Polish | — | 49 |
| MTEB Polish v1 · Pair Classification · Polish | — | 86.9 |
| MTEB Polish v1 · STS · Polish | — | 72.1 |
| MTEB Portuguese v1 · Classification · Portuguese | — | 67.7 |
| MTEB Portuguese v1 · STS · Portuguese | — | 85.6 |
| MTEB Russian v1.1 · Mean over tasks · Russian | — | 70.1 |
| MTEB Russian v1.1 · Mean over task types · Russian | — | 67.5 |
| MTEB Russian v1.1 · Classification · Russian | — | 73.6 |
| MTEB Russian v1.1 · Clustering · Russian | — | 65.1 |
| MTEB Russian v1.1 · Multilabel Classification · Russian | — | 43.3 |
| MTEB Russian v1.1 · Reranking · Russian | — | 68.7 |
| MTEB Russian v1.1 · Retrieval · Russian | — | 76.4 |
| MTEB Russian v1.1 · STS · Russian | — | 78.5 |
| MTEB Scandinavian v1 · Mean over tasks · multilingual (6 languages) | — | 68.6 |
| MTEB Scandinavian v1 · Mean over task types · multilingual (6 languages) | — | 69.6 |
| MTEB Scandinavian v1 · Classification · multilingual (6 languages) | — | 72.9 |
| MTEB Scandinavian v1 · Clustering · multilingual (2 languages) | — | 54.9 |
| MTEB Scandinavian v1 · Retrieval · multilingual (3 languages) | — | 68.4 |
| MTEB Spanish v1 · Classification · Spanish | — | 87.2 |
| MTEB Spanish v1 · STS · multilingual (2 languages) | — | 82.7 |
| MTEB Thai v1 · Classification · Thai | — | 72.4 |
| MTEB Thai v1 · Reranking · Thai | — | 61.7 |
| RTEB German beta · Mean over tasks · German | — | 66.6 |
| RTEB Law beta · Mean over tasks · multilingual (4 languages) | — | 63.5 |
| MTEB English v2 · Summarization · English | — | 34.4 |
| MTEB English v2 · Clustering · English | — | 57.5 |
| MTEB English v2 · Classification · English | — | 89.8 |
| MTEB English v2 · Reranking · English | — | 50.8 |
| MTEB English v2 · STS · English | — | 88.7 |
| MTEB English v2 · Pair Classification · English | — | 87 |
| MTEB English v2 · Retrieval · English | — | 68.5 |
Specs
| Spec | Harrier OSS v1 27B | Qwen 3 Embedding 4B |
|---|---|---|
| Price | — | !$0.02 |
| Context | 33K | 33K |
| Weights | Open | Open |
| Released | Mar 2026 | Jun 2025 |
| Dimensions | 5,376 | 2,560 |
| Max input | 33K tokens | 33K tokens |
| Languages | en, Esperanto, es +90 | — |
| Memory (4-bit) | 16 GB | 2.4 GB |
| Licence | MIT | Apache-2.0 |
| Commercial use | Allowed | Allowed |
What breaks when you switch
Harrier OSS v1 27B → Qwen 3 Embedding 4B
Re-embed your whole corpus›
Vectors from different models can't be mixed; dimensions change from 5,376 to 2,560.
Languages: not verified
Qwen 3 Embedding 4B → Harrier OSS v1 27B
Re-embed your whole corpus›
Vectors from different models can't be mixed; dimensions change from 2,560 to 5,376.