Songtao Sun

2 accepted papers

2021

Masked Conditional Random Fields for Sequence Labeling

Tianwen Wei, Jianwei Qi, Shenghuan He, Songtao Sun

NAACL 2021long

Conditional Random Field (CRF) based neural models are among the most performant methods for solving sequence labeling problems. Despite its great success, CRF has the shortcoming of occasionally generating illegal sequences of tags, e.g. sequences containing an “I-” tag immediately after an “O” tag…

Cited by 26 Source ↗PDF ↗code ↗Scholar ↗

2021

Pre-training with Meta Learning for Chinese Word Segmentation

Zhen Ke, Liang Shi, Songtao Sun, Erli Meng, Bin Wang, Xipeng Qiu

NAACL 2021long

Recent researches show that pre-trained models (PTMs) are beneficial to Chinese Word Segmentation (CWS). However, PTMs used in previous works usually adopt language modeling as pre-training tasks, lacking task-specific prior segmentation knowledge and ignoring the discrepancy between pre-training ta…

Cited by 23 Source ↗PDF ↗Scholar ↗