Iain Buchan

Improving Pre-trained Language Model Sensitivity via Mask Specific losses: A case study on Biomedical NER

Adapting language models (LMs) to novel domains is often achieved through fine-tuning a pre-trained LM (PLM) on domain-specific data. Fine-tuning introduces new knowledge into an LM, enabling it to comprehend and efficiently perform a target domain task. Fine-tuning can however be inadvertently inse…