Zicheng Cai — accepted AI-conference papers

2024

EG-NAS: Neural Architecture Search with Fast Evolutionary Exploration

Zicheng Cai, Lei Chen, Peng Liu, Tongtao Ling, Yutao Lai

AAAI 2024technical

Differentiable Architecture Search (DARTS) has achieved a rapid search for excellent architectures by optimizing architecture parameters through gradient descent. However, this efficiency comes with a significant challenge: the risk of premature convergence to local optima, resulting in subpar perfo…

Cited by 7 Source ↗PDF ↗code ↗Scholar ↗

2023

BHE-DARTS: Bilevel Optimization Based on Hypergradient Estimation for Differentiable Architecture Search

Zicheng Cai, Lei Chen, Hai-Lin Liu

ICASSP 2023accepted

In this paper, we propose a stochastic bilevel optimization approach based on a hypergradient estimator, called BHE- DARTS, as a remedy for this issue that it is easy to search for locally optimal structures rather than globally optimal ones in Differentiable Architecture Search (DARTS) bilevel opti…

Cited by 0 Source ↗Scholar ↗