Him Wai Ng

Once-More: Continuous Self-Correction for Large Language Models via Perplexity-Guided Intervention

Large Language Models (LLMs) often experience compounding errors during long text generation. Early mistakes can propagate and lead to drift, faulty reasoning, or repetition. While scaling up models improves capabilities, it requires substantial computational resources, and the resulting self-correc…