K2 Horizon 375B A23B vs K2 Horizon MoVA 36B A4B

Wins 3 of 3 benchmarks
Wins 0 of 3 benchmarks
K2 Horizon 375B A23B32
K2 Horizon MoVA 36B A4B23.4
K2 Horizon 375B A23B1.5
K2 Horizon MoVA 36B A4B0
K2 Horizon 375B A23B37.2
K2 Horizon MoVA 36B A4B26.1

Specs

SpecK2 Horizon 375B A23BK2 Horizon MoVA 36B A4B
Input, per 1M$1$1
Output, per 1M$4$4
Speed, tok/s1,062—
Context524K524K
WeightsOpenOpen
ReleasedSep 2026Sep 2026
Memory (4-bit)228 GB22 GB
LicenceApache-2.0Apache-2.0
Commercial useAllowedAllowed
See images——
Read PDFs??
Hear audio——
Watch video——
Call tools✓✓
Force a tool call??
Return strict JSONPartialPartial
Search the web??
Run code??
Use a computer??

What breaks when you switch

K2 Horizon 375B A23B → K2 Horizon MoVA 36B A4B
Nothing known.
K2 Horizon MoVA 36B A4B → K2 Horizon 375B A23B
Memory (4-bit): 22 GB → 228 GB
Training behavior may differ · Self-hosted training›

Bundled Hugging Face training may differ from native xLLM, including load-balancing loss; continue original pretraining with native xLLM checkpoints and runtime.