Looking for Confirmations: An Effective and Human-Like Visual Dialogue Strategy
Alberto Testoni, Raffaella Bernardi
Abstract
Generating goal-oriented questions in Visual Dialogue tasks is a challenging and longstanding problem. State-Of-The-Art systems are shown to generate questions that, although grammatically correct, often lack an effective strategy and sound unnatural to humans. Inspired by the cognitive literature on information search and cross-situational word learning, we design Confirm-it, a model based on a beam search re-ranking algorithm that guides an effective goal-oriented strategy by asking questions that confirm the model’s conjecture about the referent. We take the GuessWhat?! game as a case-study. We show that dialogues generated by Confirm-it are more natural and effective than beam search decoding without re-ranking.
BibTeX
@inproceedings{testoni-bernardi-2021-looking,
title = "Looking for Confirmations: An Effective and Human-Like Visual Dialogue Strategy",
author = "Testoni, Alberto and
Bernardi, Raffaella",
editor = "Moens, Marie-Francine and
Huang, Xuanjing and
Specia, Lucia and
Yih, Scott Wen-tau",
booktitle = "Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing",
month = nov,
year = "2021",
address = "Online and Punta Cana, Dominican Republic",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.emnlp-main.736/",
doi = "10.18653/v1/2021.emnlp-main.736",
pages = "9330--9338"
}