Abhijeet Mulgund

Relating Misfit to Gain in Weak-to-Strong Generalization Beyond the Squared Loss

The paradigm of weak-to-strong generalization constitutes the training of a strong AI model on data labeled by a weak AI model, with the goal that the strong model nevertheless outperforms its weak supervisor on the target task of interest. For the setting of real-valued regression with the squared…