2023
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding
EMNLP 2023long findings
Scientific literature understanding tasks have gained significant attention due to their potential to accelerate scientific discovery. Pre-trained language models (LMs) have shown effectiveness in these tasks, especially when tuned via contrastive learning. However, jointly utilizing pre-training da…