2023
Improving Bert Fine-Tuning via Stabilizing Cross-Layer Mutual Information
ICASSP 2023accepted
Fine-tuning pre-trained language models, such as BERT, has shown enormous success among various NLP tasks. Though simple and effective, the process of fine-tuning has been found unstable, which often leads to unexpected poor performance. To increase stability and generalizability, most existing work…