2026
Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization
ICML 2026poster
Neural networks (NNs) trained under different hyperparameters can fall into distinct training ``regimes'', with models in the same regime showing homogeneous properties and models across regimes differing qualitatively. In this paper, we analyze multi-regime patterns in scientific machine learning (…