Harrier OSS v1 27B vs Llama Embed Nemotron 8B
Harrier OSS v1 27B74.3
Llama Embed Nemotron 8B69.5
Harrier OSS v1 27B93.6
Llama Embed Nemotron 8B92.1
Harrier OSS v1 27B52.8
Llama Embed Nemotron 8B49.9
Harrier OSS v1 27B26
Llama Embed Nemotron 8B22
Harrier OSS v1 27B64.4
Llama Embed Nemotron 8B62.5
Harrier OSS v1 27B55
Llama Embed Nemotron 8B57
Harrier OSS v1 27B86.8
Llama Embed Nemotron 8B88.5
Harrier OSS v1 27B76.6
Llama Embed Nemotron 8B56.3
Harrier OSS v1 27B64.2
Llama Embed Nemotron 8B61.1
Harrier OSS v1 27B86
Llama Embed Nemotron 8B81.7
Harrier OSS v1 27B79.9
Llama Embed Nemotron 8B73.2
Harrier OSS v1 27B58.9
Llama Embed Nemotron 8B54.4
Harrier OSS v1 27B5.4
Llama Embed Nemotron 8B10.8
Harrier OSS v1 27B36.4
Llama Embed Nemotron 8B29.9
Harrier OSS v1 27B85.4
Llama Embed Nemotron 8B84
Harrier OSS v1 27B67.3
Llama Embed Nemotron 8B67.8
Harrier OSS v1 27B78.3
Llama Embed Nemotron 8B68.7
Harrier OSS v1 27B80
Llama Embed Nemotron 8B79.4
Harrier OSS v1 27B38.1
Llama Embed Nemotron 8B29
Harrier OSS v1 27B85
Llama Embed Nemotron 8B79.6
| Benchmark | Harrier OSS v1 27B | Llama Embed Nemotron 8B |
|---|---|---|
| MTEB multilingual v2 · Mean over tasks · multilingual (1037 languages) | 74.3 | 69.5 |
| FollowIR · Mean over tasks · English | 5.4 | 10.8 |
| FollowIR · Mean over task types · English | 5.4 | 10.8 |
| FollowIR · Instruction Reranking · English | 5.4 | 10.8 |
| MTEB Europe v1 · Bitext Mining · multilingual (28 languages) | 93.6 | 92.1 |
| MTEB Europe v1 · Clustering · multilingual (29 languages) | 52.8 | 49.9 |
| MTEB Europe v1 · Instruction Reranking · English | 5.4 | 10.8 |
| MTEB Europe v1 · Multilabel Classification · multilingual (23 languages) | 26 | 22 |
| MTEB Europe v1 · Reranking · multilingual (12 languages) | 64.4 | 62.5 |
| MTEB French v1 · Pair Classification · French | 72.4 | 66.8 |
| MTEB Indic v1 · Clustering · multilingual (21 languages) | 55 | 57 |
| MTEB Indic v1 · Pair Classification · Hindi | 87.6 | 80.1 |
| MTEB Indic v1 · Reranking · multilingual (2 languages) | 86.8 | 88.5 |
| MTEB Indic v1 · STS · multilingual (13 languages) | 63.4 | 58.2 |
| MTEB Korean v2 · Retrieval · multilingual (2 languages) | 76.6 | 56.3 |
| MTEB multilingual v2 · Mean over task types · multilingual (1037 languages) | 64.2 | 61.1 |
| MTEB multilingual v2 · Bitext Mining · multilingual (1026 languages) | 86 | 81.7 |
| MTEB multilingual v2 · Classification · multilingual (119 languages) | 79.9 | 73.2 |
| MTEB multilingual v2 · Clustering · multilingual (208 languages) | 58.9 | 54.4 |
| MTEB multilingual v2 · Instruction Reranking · English | 5.4 | 10.8 |
| MTEB multilingual v2 · Multilabel Classification · multilingual (25 languages) | 36.4 | 29.9 |
| MTEB multilingual v2 · Pair Classification · multilingual (24 languages) | 85.4 | 84 |
| MTEB multilingual v2 · Reranking · multilingual (22 languages) | 67.3 | 67.8 |
| MTEB multilingual v2 · Retrieval · multilingual (120 languages) | 78.3 | 68.7 |
| MTEB multilingual v2 · STS · multilingual (35 languages) | 80 | 79.4 |
| MTEB Dutch v1 · Reranking · Dutch | 90.9 | 91.7 |
| MTEB Portuguese v1 · Multilabel Classification · Portuguese | 38.1 | 29 |
| MTEB Russian v1.1 · Pair Classification · Russian | 61.5 | 67.2 |
| MTEB Scandinavian v1 · Bitext Mining · multilingual (3 languages) | 85 | 79.6 |
| MTEB Spanish v1 · Pair Classification · Spanish | 81.2 | 74.8 |
| MTEB Thai v1 · Clustering · Thai | 55.3 | 63.4 |
| MTEB Thai v1 · Pair Classification · Thai | 88.5 | 81.4 |
| MTEB Dutch v1 · Mean over tasks · Dutch | — | 66.2 |
| MTEB Dutch v1 · Mean over task types · Dutch | — | 70.7 |
| MTEB Dutch v1 · Classification · Dutch | — | 73.4 |
| MTEB Dutch v1 · Clustering · Dutch | — | 50.8 |
| MTEB Dutch v1 · Multilabel Classification · Dutch | — | 41.5 |
| MTEB Dutch v1 · Pair Classification · Dutch | — | 83.9 |
| MTEB Dutch v1 · Retrieval · Dutch | — | 67 |
| MTEB Dutch v1 · STS · Dutch | — | 86.4 |
Specs
| Spec | Harrier OSS v1 27B | Llama Embed Nemotron 8B |
|---|---|---|
| Context | 33K | 33K |
| Weights | Open | Open |
| Released | Mar 2026 | Oct 2025 |
| Dimensions | 5,376 | 4,096 |
| Max input | 33K tokens | 131K tokens |
| Languages | en, Esperanto, es +90 | — |
| Memory (4-bit) | 16 GB | 4.5 GB |
| Licence | MIT | https://huggingface.co/nvidia/llama-embed-nemotron-8b/blob/main/LICENSE |
| Commercial use | Allowed | Restricted |
What breaks when you switch
Harrier OSS v1 27B → Llama Embed Nemotron 8B
Re-embed your whole corpus›
Vectors from different models can't be mixed; dimensions change from 5,376 to 4,096.
Languages: not verified
Llama Embed Nemotron 8B → Harrier OSS v1 27B
Re-embed your whole corpus›
Vectors from different models can't be mixed; dimensions change from 4,096 to 5,376.