Gwen Yidou Weng

TRACE Back from the Future: A Probabilistic Reasoning Approach to Controllable Language Generation

As large language models (LMs) advance, there is an increasing need to control their outputs to align with human values (e.g., detoxification) or desired attributes (e.g., personalization, topic). However, autoregressive models focus on next-token predictions and struggle with global properties that…