EMNLP 2022industry2 citations
Improving Large-Scale Conversational Assistants using Model Interpretation based Training Sample Selection
Stefan Schroedl, Manoj Kumar, Kiana Hajebi, Morteza Ziyadi, Sriram Venkatapathy, Anil Ramakrishna, Rahul Gupta, Pradeep Natarajan
Abstract
This paper presents an approach to identify samples from live traffic where the customer implicitly communicated satisfaction with Alexa’s responses, by leveraging interpretations of model behavior. Such customer signals are noisy and adding a large number of samples from live traffic to training set makes re-training infeasible. Our work addresses these challenges by identifying a small number of samples that grow training set by ~0.05% while producing statistically significant improvements in both offline and online tests.
BibTeX
@inproceedings{schroedl-etal-2022-improving,
title = "Improving Large-Scale Conversational Assistants using Model Interpretation based Training Sample Selection",
author = "Schroedl, Stefan and
Kumar, Manoj and
Hajebi, Kiana and
Ziyadi, Morteza and
Venkatapathy, Sriram and
Ramakrishna, Anil and
Gupta, Rahul and
Natarajan, Pradeep",
editor = "Li, Yunyao and
Lazaridou, Angeliki",
booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: Industry Track",
month = dec,
year = "2022",
address = "Abu Dhabi, UAE",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2022.emnlp-industry.37/",
doi = "10.18653/v1/2022.emnlp-industry.37",
pages = "371--378"
}