Jayaraman Thiagarajan

A Statistical Mechanics Framework for Task-Agnostic Sample Design in Machine Learning

In this paper, we present a statistical mechanics framework to understand the effect of sampling properties of training data on the generalization gap of machine learning (ML) algorithms. We connect the generalization gap to the spatial properties of a sample design characterized by the pair correla…