Ultra-Fast Language Generation via Discrete Diffusion Divergence Instruct

Haoyang Zheng, Xinyang Liu, Cindy Xiangrui Kong, Nan Jiang, Zheyuan Hu, Weijian Luo, Wei Deng, Guang Lin, in ICLR 2026, 2026.

Abstract: Discrete Diffusion Divergence Instruct accelerates language generation with a discrete diffusion distillation framework, achieving ultra-fast generation while preserving high-quality instruction-following behavior.

[arxiv] [project]