Andrea Mezzalira

Semantic Diversity for Natural Language Understanding Evaluation in Dialog Systems

The quality of Natural Language Understanding (NLU) models is typically evaluated using aggregated metrics on a large number of utterances. In a dialog system, though, the manual analysis of failures on specific utterances is a time-consuming and yet critical endeavor to guarantee a high-quality cus…