Xuan-Yi Zhu

Step Back to Leap Forward: Self-Backtracking for Symbolic Reasoning and Planning in Language Models

Although autoregressive language models demonstrated remarkable performance across various tasks, their effectiveness in symbolic reasoning and decision-making scenarios remains constrained. Recent research indicates that training language models to emulate symbolic search algorithms (e.g. depth-fi