Thanapapas Horsuwan

Rational LAMOL: A Rationale-based Lifelong Learning Framework

Lifelong learning (LL) aims to train a neural network on a stream of tasks while retaining knowledge from previous tasks. However, many prior attempts in NLP still suffer from the catastrophic forgetting issue, where the model completely forgets what it just learned in the previous tasks. In this pa…