Neural Differentiation in Deep Networks: A Theoretical Framework for Expressivity and Representational Diversity
We begin by developing a mathematical framework of neural differentiation, formulated at the level of individual neurons. This framework formalizes the principle that each neuron should acquire a distinct representational role within the network, thereby avoiding redundancy and maximizing collective