Semi-Supervised Learning with Noisy Covariates: Generalization Bounds and Distribution Regression
In modern machine learning pipelines, abundant pretrained representations act as noisy proxy covariates while task-specific labels remain scarce. We study semi-supervised regression in this noisy-covariate setting and propose a simple two-stage estimator. We derive finite-sample generalization bound…