Tatsumi Sunada

Training-Free Determination of Network Width via Neural Tangent Kernel

Determining an appropriate size for an artificial neural network under computational constraints is a fundamental challenge. This paper introduces a practical metric, derived from Neural Tangent Kernel (NTK), for estimating the minimum necessary network width with respect to test loss -- prior to tr…