2024
How Deep Networks Learn Sparse and Hierarchical Data: the Sparse Random Hierarchy Model
ICML 2024spotlight
Understanding what makes high-dimensional data learnable is a fundamental question in machine learning. On the one hand, it is believed that the success of deep learning lies in its ability to build a hierarchy of representations that become increasingly more abstract with depth, going from simple f…