Knowledge-Aware Meta-learning for Low-Resource Text Classification
Huaxiu Yao, Ying-xin Wu, Maruan Al-Shedivat, Eric Xing
Abstract
Meta-learning has achieved great success in leveraging the historical learned knowledge to facilitate the learning process of the new task. However, merely learning the knowledge from the historical tasks, adopted by current meta-learning algorithms, may not generalize well to testing tasks when they are not well-supported by training tasks. This paper studies a low-resource text classification problem and bridges the gap between meta-training and meta-testing tasks by leveraging the external knowledge bases. Specifically, we propose KGML to introduce additional representation for each sentence learned from the extracted sentence-specific knowledge graph. The extensive experiments on three datasets demonstrate the effectiveness of KGML under both supervised adaptation and unsupervised adaptation settings.
BibTeX
@inproceedings{yao-etal-2021-knowledge,
title = "Knowledge-Aware Meta-learning for Low-Resource Text Classification",
author = "Yao, Huaxiu and
Wu, Ying-xin and
Al-Shedivat, Maruan and
Xing, Eric",
editor = "Moens, Marie-Francine and
Huang, Xuanjing and
Specia, Lucia and
Yih, Scott Wen-tau",
booktitle = "Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing",
month = nov,
year = "2021",
address = "Online and Punta Cana, Dominican Republic",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.emnlp-main.136/",
doi = "10.18653/v1/2021.emnlp-main.136",
pages = "1814--1821"
}