ICML 2024poster29 citations
Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling
Weijia Xu, Andrzej Banburski, Nebojsa Jojic
Abstract
We introduce Reprompting, an iterative sampling algorithm that automatically learns the Chain-of-Thought (CoT) recipes for a given task without human intervention. Through Gibbs sampling, Reprompting infers the CoT recipes that work consistently well for a set of training samples by iteratively sampling new recipes using previously sampled recipes as parent prompts to solve other training problems. We conduct extensive experiments on 20 challenging reasoning tasks. Results show that Reprompting outperforms human-written CoT prompts substantially by +9.4 points on average. It also achieves consistently better performance than the state-of-the-art prompt optimization and decoding algorithms.
BibTeX
@inproceedings{
xu2024reprompting,
title={Reprompting: Automated Chain-of-Thought Prompt Inference Through Gibbs Sampling},
author={Weijia Xu and Andrzej Banburski and Nebojsa Jojic},
booktitle={Forty-first International Conference on Machine Learning},
year={2024},
url={https://openreview.net/forum?id=D8zn1DnTuj}
}