Carl De Sousa Trias

Find the Lady: Permutation and Re-synchronization of Deep Neural Networks

Deep neural networks are characterized by multiple symmetrical, equi-loss solutions that are redundant. Thus, the order of neurons in a layer and feature maps can be given arbitrary permutations, without affecting (or minimally affecting) their output. If we shuffle these neurons, or if we apply to…