Enrico Ventura

Manifolds, Random Matrices and Spectral Gaps: The geometric phases of generative diffusion

In this paper, we investigate the latent geometry of generative diffusion models under the manifold hypothesis. For this purpose, we analyze the spectrum of eigenvalues (and singular values) of the Jacobian of the score function, whose discontinuities (gaps) reveal the presence and dimensionality of…