Building large language models that can act like agents, performing tasks such as coding, research, and tool use, requires training data and details that most companies keep secret. This makes it hard for others to study or reproduce those capabilities.
K2-Horizon releases six fully open models, from a tiny 0.9B-parameter one for phones up to a 375B-parameter flagship that activates only 23B parameters per token. The team introduces two new techniques: Mixture-of-Value Attention, which applies a to attention calculations, and Uno, which speeds up text generation by up to 2.2 times without a separate draft model.
The largest model is competitive with or beats strong open models of its size on agentic and coding benchmarks, and matches a much larger dense model while using one-seventh the active parameters. By releasing everything, training data, code, and every intermediate checkpoint, this work enables controlled studies of scale and transparency.
