2021
Enhancing Document Ranking with Task-adaptive Training and Segmented Token Recovery Mechanism
EMNLP 2021main
In this paper, we propose a new ranking model DR-BERT, which improves the Document Retrieval (DR) task by a task-adaptive training process and a Segmented Token Recovery Mechanism (STRM). In the task-adaptive training, we first pre-train DR-BERT to be domain-adaptive and then make the two-phase fine…