Ye Chao

Rehearsal-free Continual Language Learning via Efficient Parameter Isolation

We study the problem of defying catastrophic forgetting when learning a series of language processing tasks. Compared with previous methods, we emphasize the importance of not caching history tasks’ data, which makes the problem more challenging. Our proposed method applies the parameter isolation s…