Stochastic Gradient Descent-Induced Drift of Representation in a Two-Layer Neural Network
Representational drift refers to over-time changes in neural activation accompanied by a stable task performance. Despite being observed in the brain and in artificial networks, the mechanisms of drift and its implications are not fully understood. Motivated by recent experimental findings of stimul…