2022
RoCBert: Robust Chinese Bert with Multimodal Contrastive Pretraining
ACL 2022long
Large-scale pretrained language models have achieved SOTA results on NLP tasks. However, they have been shown vulnerable to adversarial attacks especially for logographic languages like Chinese. In this work, we propose RoCBert: a pretrained Chinese Bert that is robust to various forms of adversaria…