← Search

Maciej Janowski

3 accepted papers

2023

PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning

NeurIPS 2023poster

Hyperparameters of Deep Learning (DL) pipelines are crucial for their downstream performance. While a large number of methods for Hyperparameter Optimization (HPO) have been developed, their incurred costs are often untenable for modern DL. Consequently, manual experimentation is still the most pre…

2023

Scaling Laws for Hyperparameter Optimization

NeurIPS 2023poster

Hyperparameter optimization is an important subfield of machine learning that focuses on tuning the hyperparameters of a chosen algorithm to achieve peak performance. Recently, there has been a stream of methods that tackle the issue of hyperparameter optimization, however, most of the methods do no…

2022

JAHS-Bench-201: A Foundation For Research On Joint Architecture And Hyperparameter Search

NeurIPS 2022accept

The past few years have seen the development of many benchmarks for Neural Architecture Search (NAS), fueling rapid progress in NAS research. However, recent work, which shows that good hyperparameter settings can be more important than using the best architecture, calls for a shift in focus towards…

Cited by 30SourcePDFScholar