Zhuoli Jin

Beyond Skip Connection: Pooling and Unpooling Design for Elimination Singularities

Training deep Convolutional Neural Networks (CNNs) presents unique challenges, including the pervasive issue of elimination singularities—consistent deactivation of nodes leading to degenerate manifolds within the loss landscape. These singularities impede efficient learning by disrupting feature pr…