wenchun.gao

LOIRE: LifelOng learning on Incremental data via pre-trained language model gRowth Efficiently

Large-scale pre-trained language models (PLMs) require significant computational resources to train from scratch on large volumes of data. But in the real world, emerging data from diverse sources may not be initially available for pre-training. Recent studies on lifelong learning have tried to solv…