Bo Yi

Understanding and Enhancing Differentiable Architecture Search from Information Bottleneck Perspective

Performance collapse is an intractable issue of Differentiable Architecture Search (DAS), where severe performance degradation of DAS happens when it trains on different search spaces or datasets. We theoretically analyze the issue from the information bottleneck (IB) perspective, and disclose that