← Search

Danny Stoll

5 accepted papers

2023

Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars

NeurIPS 2023poster

The discovery of neural architectures from simple building blocks is a long-standing goal of Neural Architecture Search (NAS). Hierarchical search spaces are a promising step towards this goal but lack a unifying search space design framework and typically only search over some limited aspect of arc…

2023

PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning

NeurIPS 2023poster

Hyperparameters of Deep Learning (DL) pipelines are crucial for their downstream performance. While a large number of methods for Hyperparameter Optimization (HPO) have been developed, their incurred costs are often untenable for modern DL. Consequently, manual experimentation is still the most pre…

2022

$\pi$BO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimization

ICLR 2022poster

Bayesian optimization (BO) has become an established framework and popular tool for hyperparameter optimization (HPO) of machine learning (ML) algorithms. While known for its sample-efficiency, vanilla BO can not utilize readily available prior beliefs the practitioner has on the potential location…

Cited by 80SourcePDFScholar
2022

JAHS-Bench-201: A Foundation For Research On Joint Architecture And Hyperparameter Search

NeurIPS 2022accept

The past few years have seen the development of many benchmarks for Neural Architecture Search (NAS), fueling rapid progress in NAS research. However, recent work, which shows that good hyperparameter settings can be more important than using the best architecture, calls for a shift in focus towards…

Cited by 30SourcePDFScholar