Alberto Bassi

When Bias Helps Learning: Bridging Initial Prejudice and Trainability

Understanding the statistical properties of deep neural networks (DNNs) at initialization is crucial for elucidating both their trainability and the intrinsic architectural biases they encode prior to data exposure. Mean-field (MF) analyses have demonstrated that the parameter distribution in random…