2022
Autoregressive Search Engines: Generating Substrings as Document Identifiers
NeurIPS 2022accept
Knowledge-intensive language tasks require NLP systems to both provide the correct answer and retrieve supporting evidence for it in a given corpus. Autoregressive language models are emerging as the de-facto standard for generating answers, with newer and more powerful systems emerging at an astoni…