GuidedSampling: Steering LLMs Towards Diverse Candidate Solutions at Inference-Time
Repeated Sampling (RS) is a simple inference-time algorithm that has been shown to improve model performance on complex tasks. Although it is an effective way of scaling inference time, it often struggles to generate diverse solution candidates, frequently relying on the same underlying approach to…