Focal Training and Tagger Decouple for Grammatical Error Correction

Minghuan Tan; Min Yang; Ruifeng Xu

ACL 2023findings6 citations

Focal Training and Tagger Decouple for Grammatical Error Correction

Abstract

In this paper, we investigate how to improve tagging-based Grammatical Error Correction models. We address two issues of current tagging-based approaches, label imbalance issue, and tagging entanglement issue. Then we propose to down-weight the loss of well-classified labels using Focal Loss and decouple the error detection layer from the label tagging layer through an extra self-attention-based matching module. Experiments over three latest Chinese Grammatical Error Correction datasets show that our proposed methods are effective. We further analyze choices of hyper-parameters for Focal Loss and inference tweaking.

BibTeX

@inproceedings{tan-etal-2023-focal,
    title = "Focal Training and Tagger Decouple for Grammatical Error Correction",
    author = "Tan, Minghuan  and
      Yang, Min  and
      Xu, Ruifeng",
    editor = "Rogers, Anna  and
      Boyd-Graber, Jordan  and
      Okazaki, Naoaki",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2023",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.findings-acl.370/",
    doi = "10.18653/v1/2023.findings-acl.370",
    pages = "5978--5985"
}