← Search

Sudhir Mudur

3 accepted papers

2023

Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learning

ICML 2023poster

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle the catastrophic forgetting problem. Having access to previou…

2023

Simulated Annealing in Early Layers Leads to Better Generalization

CVPR 2023poster

Recently, a number of iterative learning methods have been introduced to improve generalization. These typically rely on training for longer periods of time in exchange for improved generalization. LLF (later-layer-forgetting) is a state-of-the-art method in this category. It strengthens learning in…

2022

Probing Representation Forgetting in Supervised and Unsupervised Continual Learning

CVPR 2022poster

Continual Learning (CL) research typically focuses on tackling the phenomenon of catastrophic forgetting in neural networks. Catastrophic forgetting is associated with an abrupt loss of knowledge previously learned by a model when the task, or more broadly the data distribution, being trained on cha…

Cited by 100PDFcodeScholar