Augustin Cosse

Why Deep Jacobian Spectra Separate: Depth-Induced Scaling and Singular-Vector Alignment

Understanding why gradient-based training in deep networks exhibits strong implicit bias remains challenging, in part because tractable singular-value dynamics are typically available only for balanced deep linear models. We propose an alternative route based on two theoretically grounded and empiri…