Chenxia Tang

Top-n𝜎: Eliminating Noise in Logit Space for Robust Token Sampling of LLM

Large language models (LLMs) rely heavily on sampling methods to generate diverse and high-quality text.While existing sampling methods like top-p and min-p have identified the detrimental effects of low-probability tails in LLMs’ outputs, they still fail to effectively distinguish between diversity…