← Search

MohammadReza Davari

4 accepted papers

2023

Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learning

ICML 2023poster

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle the catastrophic forgetting problem. Having access to previou…

2023

Reliability of CKA as a Similarity Measure in Deep Learning

ICLR 2023poster

Comparing learned neural representations in neural networks is a challenging but important problem, which has been approached in different ways. The Centered Kernel Alignment (CKA) similarity metric, particularly its linear variant, has recently become a popular approach and has been widely used to…

Cited by 51SourcePDFScholar
2022

Probing Representation Forgetting in Supervised and Unsupervised Continual Learning

CVPR 2022poster

Continual Learning (CL) research typically focuses on tackling the phenomenon of catastrophic forgetting in neural networks. Catastrophic forgetting is associated with an abrupt loss of knowledge previously learned by a model when the task, or more broadly the data distribution, being trained on cha…

Cited by 100PDFcodeScholar