Runyan Tan

$p\textrm{-less}$ Sampling: A Robust Hyperparameter-Free Approach for LLM Decoding

Obtaining high-quality outputs from Large Language Models (LLMs) often depends upon the choice of a sampling-based decoding strategy to probabilistically choose the next token at each generation step. While a variety of such sampling methods have been proposed, their performance can be sensitive to…