Andy (DiJia) Su

dTRPO : Trajectory Reduction in Policy Optimization of Diffusion Large Language Models

Diffusion Large Language Models (dLLMs) introduce a new paradigm for language generation and thus induce new challenges in aligning dLLMs for human preference. In this work, aim to optimize the dLLM generation process by developing a theoretical formulation and an efficient and effective quantificat…