Mengxiang Li

Towards Generalization beyond Pointwise Learning: A Unified Information-theoretic Perspective

The recent surge in contrastive learning has intensified the interest in understanding the generalization of non-pointwise learning paradigms. While information-theoretic analysis achieves remarkable success in characterizing the generalization behavior of learning algorithms, its applicability is l…