← Search

Ruidan He

9 accepted papers

2022

Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillation

ACL 2022findings

Document-level Relation Extraction (DocRE) is a more challenging task compared to its sentence-level counterpart. It aims to extract relations from multiple sentences at once. In this paper, we propose a semi-supervised framework for DocRE with three novel components. Firstly, we use an axial attent…

2022

Domain Generalization for Text Classification with Memory-Based Supervised Contrastive Learning

COLING 2022main

While there is much research on cross-domain text classification, most existing approaches focus on one-to-one or many-to-one domain adaptation. In this paper, we tackle the more challenging task of domain generalization, in which domain-invariant representations are learned from multiple source dom…

2022

Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples

EMNLP 2022main

Knowledge-enhanced language representation learning has shown promising results across various knowledge-intensive NLP tasks. However, prior methods are limited in efficient utilization of multilingual knowledge graph (KG) data for language model (LM) pretraining. They often train LMs with KGs in in…

2022

IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Tasks

ACL 2022long

Traditionally, a debate usually requires a manual preparation process, including reading plenty of articles, selecting the claims, identifying the stances of the claims, seeking the evidence for the claims, etc. As the AI debate attracts more attention these years, it is worth exploring the methods…

2022

MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER

ACL 2022long

Data augmentation is an effective solution to data scarcity in low-resource scenarios. However, when applied to token-level tasks such as NER, data augmentation methods often suffer from token-label misalignment, which leads to unsatsifactory performance. In this work, we propose Masked Entity Langu…

2021

Bootstrapped Unsupervised Sentence Representation Learning

ACL 2021long

As high-quality labeled data is scarce, unsupervised sentence representation learning has attracted much attention. In this paper, we propose a new framework with a two-branch Siamese Network which maximizes the similarity between two augmented views of each sentence. Specifically, given one augment…

2021

Cross-lingual Aspect-based Sentiment Analysis with Aspect Term Code-Switching

EMNLP 2021main

Many efforts have been made in solving the Aspect-based sentiment analysis (ABSA) task. While most existing studies focus on English texts, handling ABSA in resource-poor languages remains a challenging problem. In this paper, we consider the unsupervised cross-lingual transfer for the ABSA task, wh…

2021

On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation

ACL 2021long

Adapter-based tuning has recently arisen as an alternative to fine-tuning. It works by adding light-weight adapter modules to a pretrained language model (PrLM) and only updating the parameters of adapter modules when learning on a downstream task. As such, it adds only a few trainable parameters pe…

Cited by 224SourcePDFScholar
2020

Unsupervised Domain Adaptation of a Pretrained Cross-Lingual Language Model

IJCAI 2020poster

Recent research indicates that pretraining cross-lingual language models on large-scale unlabeled texts yields significant performance improvements over various cross-lingual and low-resource tasks. Through training on one hundred languages and terabytes of texts, cross-lingual language models have…