Shahina Mohd Azam Ansari

Efficient NLP Model Finetuning via Multistage Data Filtering

As model finetuning is central to the modern NLP, we set to maximize its efficiency. Motivated by redundancy in training examples and the sheer sizes of pretrained models, we exploit a key opportunity: training only on important data. To this end, we set to filter training examples in a streaming fa…