Language models can produce better writing without sacrificing variety
The authors propose PRISM, a training-time framework that internalizes output diversity in LLMs. By pairing each prompt with diverse multi-teacher solutions and injecting Gaussian noise into special-token embeddings during training, the model learns to use that noise as a signal to produce varied outputs. On writing and reasoning benchmarks, PRISM improves both quality and diversity, shifting the Pareto frontier outward.
