AI Insight
This research addresses a fundamental limitation in Diffusion Language Models (DLMs): their inability to reliably distinguish and correct erroneous tokens during iterative refinement. The authors introduce a correction-oriented training approach that explicitly supervises corrupted visible tokens, enabling models to assign lower confidence to incorrect tokens and iteratively refine them while preserving correct content. Testing on models ranging from 0.5B to 16B parameters demonstrates improved performance in code completion, mathematical reasoning, and parallel decoding tasks compared to standard masked-diffusion fine-tuning.
Why it matters
This work could significantly improve AI systems that require iterative refinement capabilities, such as code debugging tools, mathematical problem solvers, and text editing assistants. The proposed training method offers a computationally efficient way to enhance model reliability without requiring additional inference-time compute beyond what diffusion models already use.
Understand the Science
⚠️ Preprint – Noch nicht peer-reviewed
Dieser Artikel wurde noch nicht von unabhängigen Experten begutachtet. Die Ergebnisse sind vorläufig und sollten mit Vorsicht interpretiert werden.
Abstract: While Diffusion Language Models (DLMs) are theoretically well-suited for iterative refinement due to their non-causal structure, off-the-shelf masked diffusion language models (MDLMs) often fail to reliably revise incorrect tokens in practice. The key challenge is that the model cannot tell correct from erroneous visible tokens: standard MDLM training supervises only masked positions, undermining confidence-guided refinement. We study corrective behavior in DLMs, the ability to assign lower confidence to incorrect tokens and iteratively refine them while preserving correct content. Under matched compute and data, we show that conventional masked-diffusion fine-tuning induces much less of this capability than a correction-oriented post-training principle that explicitly supervises visible corrupted tokens, which enables discriminative confidence and targeted refinement. We further find that also supervising clean visible tokens, as in BERT- or GIDD-style training, stops remask-based refinement from improving with additional steps. To evaluate it, we introduce the Code Revision Benchmark, a controllable, executable benchmark for error localization and in-place correction. The effect transfers from a 0.5B model to LLaDA-8B and persists, with a smaller margin, when corruptions are drawn from the base model’s own most plausible predictions. The same error-aware confidence also makes parallel decoding more effective. In HumanEval(+) code completion at 0.5B, mathematical reasoning at 16B, and high-entropy parallel decoding with remasking (ParallelBench), models trained with our objective outperform standard masked-diffusion fine-tuning under matched compute, and outperform the base model on HumanEval(+), MATH, and the high-entropy ParallelBench average; at 8B, neither objective improves from-scratch generation over the base model. Code and data: https://github.com/zhangshuibai/CDLM
Source: Corrective Diffusion Language Models