2021
Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models
EMNLP 2021main
Commonsense reasoning benchmarks have been largely solved by fine-tuning language models. The downside is that fine-tuning may cause models to overfit to task-specific data and thereby forget their knowledge gained during pre-training. Recent works only propose lightweight model updates as models ma…