Distributionally Robust Finetuning BERT for Covariate Drift in Spoken Language Understanding
In this study, we investigate robustness against covariate drift in spoken language understanding (SLU). Covariate drift can occur in SLUwhen there is a drift between training and testing regarding what users request or how they request it. To study this we propose a method that exploits natural var…