Shanchan Wu

DiNADO: Norm-Disentangled Neurally-Decomposed Oracles for Controlling Language Models

NeurAlly-Decomposed Oracle (NADO) is a powerful approach for controllable generation with large language models. It is designed to avoid catastrophic forgetting while achieving guaranteed convergence to an entropy-maximized closed-form optimal solution with reasonable modeling capacity. Despite the…