Sridhar Thiagarajan

Inference-Aware Fine-Tuning for Best-of-N Sampling in Large Language Models

Recent studies indicate that effectively utilizing inference-time compute is crucial for attaining good performance from large language models (LLMs). Specifically, the Best-of-N (BoN) inference strategy, where an LLM generates multiple responses and a verifier selects the best, has shown strong emp…