COLING 2020main49 citations

Meta-Information Guided Meta-Learning for Few-Shot Relation Classification

Bowen Dong, Yuan Yao, Ruobing Xie, Tianyu Gao, Xu Han, Zhiyuan Liu, Fen Lin, Leyu Lin

Abstract

Few-shot classification requires classifiers to adapt to new classes with only a few training instances. State-of-the-art meta-learning approaches such as MAML learn how to initialize and fast adapt parameters from limited instances, which have shown promising results in few-shot classification. However, existing meta-learning models solely rely on implicit instance-based statistics, and thus suffer from instance unreliability and weak interpretability. To solve this problem, we propose a novel meta-information guided meta-learning (MIML) framework, where semantic concepts of classes provide strong guidance for meta-learning in both initialization and adaptation. In effect, our model can establish connections between instance-based information and semantic-based information, which enables more effective initialization and faster adaptation. Comprehensive experimental results on few-shot relation classification demonstrate the effectiveness of the proposed framework. Notably, MIML achieves comparable or superior performance to humans with only one shot on FewRel evaluation.

BibTeX
@inproceedings{dong-etal-2020-meta,
    title = "Meta-Information Guided Meta-Learning for Few-Shot Relation Classification",
    author = "Dong, Bowen  and
      Yao, Yuan  and
      Xie, Ruobing  and
      Gao, Tianyu  and
      Han, Xu  and
      Liu, Zhiyuan  and
      Lin, Fen  and
      Lin, Leyu  and
      Sun, Maosong",
    editor = "Scott, Donia  and
      Bel, Nuria  and
      Zong, Chengqing",
    booktitle = "Proceedings of the 28th International Conference on Computational Linguistics",
    month = dec,
    year = "2020",
    address = "Barcelona, Spain (Online)",
    publisher = "International Committee on Computational Linguistics",
    url = "https://aclanthology.org/2020.coling-main.140/",
    doi = "10.18653/v1/2020.coling-main.140",
    pages = "1594--1605"
}
Meta-Information Guided Meta-Learning for Few-Shot Relation Classification · COLING 2020