2026
Trust Functions: Near Lossless Weak-to-Strong Generalization by Learning to Trust the Weak Teacher
ICML 2026poster
Weak-to-strong generalization studies how to improve a strong student using supervision from a weaker teacher when reliable labels are scarce. We view this primarily as a data selection problem, where the key challenge is to identify which weak labels are reliable enough to serve as a training signa…