Semin Park

SUMNAS: Supernet with Unbiased Meta-Features for Neural Architecture Search

One-shot Neural Architecture Search (NAS) usually constructs an over-parameterized network, which we call a supernet, and typically adopts sharing parameters among the sub-models to improve computational efficiency. One-shot NAS often repeatedly samples sub-models from the supernet and trains them t…