2025
Cross-regularization: Adaptive Model Complexity through Validation Gradients
ICML 2025poster
Model regularization requires extensive manual tuning to balance complexity against overfitting. Cross-regularization resolves this tradeoff by computing validation gradients that directly adapt regularization parameters during training. The method splits parameter optimization - training data guide…