2026
When Bias Helps Learning: Bridging Initial Prejudice and Trainability
ICLR 2026poster
Understanding the statistical properties of deep neural networks (DNNs) at initialization is crucial for elucidating both their trainability and the intrinsic architectural biases they encode prior to data exposure. Mean-field (MF) analyses have demonstrated that the parameter distribution in random…