2024
On the Variance of Neural Network Training with respect to Test Sets and Distributions
ICLR 2024poster
Neural network trainings are stochastic, causing the performance of trained networks to vary across repeated runs of training. We contribute the following results towards understanding this variation. (1) Despite having significant variance on their test-sets, we demonstrate that standard CIFAR-10 a…