Haoran Dang

Temperature as a Meta-Policy: Adaptive Temperature in LLM Reinforcement Learning

Temperature is a crucial hyperparameter in large language models (LLMs), controlling the trade-off between exploration and exploitation during text generation. High temperatures encourage diverse but noisy outputs, while low temperatures produce focused outputs but may cause premature convergence. Y…