2020
Eliminating the Invariance on the Loss Landscape of Linear Autoencoders
ICML 2020poster
This paper proposes a new loss function for linear autoencoders (LAEs) and analytically identifies the structure of the associated loss surface. Optimizing the conventional Mean Square Error (MSE) loss results in a decoder matrix that spans the principal subspace of the sample covariance of the data…