Hai-Lin Liu

BHE-DARTS: Bilevel Optimization Based on Hypergradient Estimation for Differentiable Architecture Search

In this paper, we propose a stochastic bilevel optimization approach based on a hypergradient estimator, called BHE- DARTS, as a remedy for this issue that it is easy to search for locally optimal structures rather than globally optimal ones in Differentiable Architecture Search (DARTS) bilevel opti…