Benjamin Fineran

The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models

In this paper, we consider the problem of sparsifying BERT models, which are a key building block for natural language processing, in order to reduce their storage and computational cost. We introduce the Optimal BERT Surgeon (oBERT), an efficient and accurate pruning method based on approximate sec…