Fan-Keng Sun*

LAMOL: LAnguage MOdeling for Lifelong Language Learning

Most research on lifelong learning applies to images or games, but not language. We present LAMOL, a simple yet effective method for lifelong language learning (LLL) based on language modeling. LAMOL replays pseudo-samples of previous tasks while requiring no extra memory or model capacity. Specific…