Juntai Cao

Why Prompt Design Matters and Works: A Complexity Analysis of Prompt Search Space in LLMs

Despite the remarkable successes of Large Language Models (LLMs), the underlying Transformer architecture has inherent limitations in handling complex reasoning tasks. Chain-of-Thought (CoT) prompting has emerged as a practical workaround, but most CoT-based methods rely on a single generic prompt l…