SIAST: A Slot Imbalance-Aware Self-Training Scheme for Semi-Supervised Slot Filling
Jiachi Liu, Sishi Xiong, Yuehuan He, Tong Zhou, Liwen Wang, Xuefeng Li, Bo Xiao
Abstract
Slot filling where labelled data are scarce could leverage the recent advances in self-training methods. However, existing self-training models ignore the prevalent imbalanced slot distribution problem in many slot filling datasets. These methods could exacerbate label imbalance during learning iterations, resulting in poorer performance in minority slot classes, which is crucial in many dialogue systems applications. To solve this, we propose a novel self-training scheme for imbalanced slot filling that aims to learn unbiased margins between slot classes while mitigating potential slot confusion, and adaptively samples pseudo-labelled data to balance the slot distribution of the training set. Experimental results show that our method achieves significant improvement on the minority slots, while also setting the new state-of-the-art for semi-supervised slot filling tasks.<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup>
BibTeX
@inproceedings{icassp2023_siastaslotimbala,
title = {SIAST: A Slot Imbalance-Aware Self-Training Scheme for Semi-Supervised Slot Filling},
author = {Jiachi Liu and Sishi Xiong and Yuehuan He and Tong Zhou and Liwen Wang and Xuefeng Li and Bo Xiao},
booktitle = {ICASSP 2023},
year = {2023}
}