2026
A Derandomization Framework for Structure Discovery: Applications in Neural Networks and Beyond
ICLR 2026poster
Understanding the dynamics of feature learning in neural networks (NNs) remains a significant challenge. The work of (Mousavi-Hosseini et al., 2023) analyzes a multiple index teacher-student setting and shows that a two-layer student attains a low-rank structure in its first-layer weights when tra…