Anurag Rao

Model Editing at Scale leads to Gradual and Catastrophic Forgetting

Editing knowledge in large language models is an attractive capability that allows us to correct incorrectly learned facts during pre-training, as well as update the model with an ever-growing list of new facts. While existing model editing techniques have shown promise, they are usually evaluated u…