← Search

Matthias De Lange

4 accepted papers

2023

Continual evaluation for lifelong learning: Identifying the stability gap

ICLR 2023top-25%

Time-dependent data-generating distributions have proven to be difficult for gradient-based training of neural networks, as the greedy updates result in catastrophic forgetting of previously learned knowledge. Despite the progress in the field of continual learning to overcome this forgetting, we sh…

2021

Continual Prototype Evolution: Learning Online From Non-Stationary Data Streams

ICCV 2021poster

Attaining prototypical features to represent class distributions is well established in representation learning. However, learning prototypes online from streaming data proves a challenging endeavor as they rapidly become outdated, caused by an ever-changing parameter space during the learning proce…

Cited by 285PDFcodeScholar
2021

Rehearsal Revealed: The Limits and Merits of Revisiting Samples in Continual Learning

ICCV 2021poster

Learning from non-stationary data streams and overcoming catastrophic forgetting still poses a serious challenge for machine learning research. Rather than aiming to improve state-of-the-art, in this work we provide insight into the limits and merits of rehearsal, one of continual learning's most es…

Cited by 118PDFcodeScholar
2020

Unsupervised Model Personalization While Preserving Privacy and Scalability: An Open Problem

CVPR 2020poster

This work investigates the task of unsupervised model personalization, adapted to continually evolving, unlabeled local user images. We consider the practical scenario where a high capacity server interacts with a myriad of resource-limited edge devices, imposing strong requirements on scalability a…

Cited by 35PDFcodeScholar