2020
Orthogonal Gradient Descent for Continual Learning
AISTATS 2020poster
Neural networks are achieving state of the art and sometimes super-human performance on learning tasks across a variety of domains. Whenever these problems require learning in a continual or sequential manner, however, neural networks suffer from the problem of catastrophic forgetting; they forget h…