Clayton H. Sanford

Expressivity of Neural Networks via Chaotic Itineraries beyond Sharkovsky’s Theorem

Given a target function $f$, how large must a neural network be in order to approximate $f$? Recent works examine this basic question on neural network expressivity from the lens of dynamical systems and provide novel “depth-vs-width” tradeoffs for a large family of functions $f$. They suggest that…