Rana Muhammad Shahroz Khan

PRANC: Pseudo RAndom Networks for Compacting Deep Models

We demonstrate that a deep model can be reparametrized as a linear combination of several randomly initialized and frozen deep models in the weight space. During training, we seek local minima that reside within the subspace spanned by these random models (i.e., `basis' networks). Our framework, PRA…