2020
LAMOL: LAnguage MOdeling for Lifelong Language Learning
ICLR 2020poster
Most research on lifelong learning applies to images or games, but not language. We present LAMOL, a simple yet effective method for lifelong language learning (LLL) based on language modeling. LAMOL replays pseudo-samples of previous tasks while requiring no extra memory or model capacity. Specific…