Lucy L Gao

Value Function based Difference-of-Convex Algorithm for Bilevel Hyperparameter Selection Problems

Existing gradient-based optimization methods for hyperparameter tuning can only guarantee theoretical convergence to stationary solutions when the bilevel program satisfies the condition that for fixed upper-level variables, the lower-level is strongly convex (LLSC) and smooth (LLS). This condition…