← Search

Daniel Goldfarb

2 accepted papers

2024

The Joint Effect of Task Similarity and Overparameterization on Catastrophic Forgetting — An Analytical Model

ICLR 2024poster

In continual learning, catastrophic forgetting is affected by multiple aspects of the tasks. Previous works have analyzed separately how forgetting is affected by either task similarity or overparameterization. In contrast, our paper examines how task similarity and overparameterization jointly affe…

Cited by 17SourcePDFScholar
2023

Analysis of Catastrophic Forgetting for Random Orthogonal Transformation Tasks in the Overparameterized Regime

AISTATS 2023poster

Overparameterization is known to permit strong generalization performance in neural networks. In this work, we provide an initial theoretical analysis of its effect on catastrophic forgetting in a continual learning setup. We show experimentally that in Permuted MNIST image classification tasks, the…

Cited by 24SourcePDFScholar