Naoki Sato — accepted AI-conference papers

2025

Explicit and Implicit Graduated Optimization in Deep Neural Networks

AAAI 2025technical

Graduated optimization is a global optimization technique that is used to minimize a multimodal nonconvex function by smoothing the objective function with noise and gradually refining the solution. This paper experimentally evaluates the performance of the explicit graduated optimization algorithm…

Cited by 0 Source ↗PDF ↗code ↗Scholar ↗

2023

Existence and Estimation of Critical Batch Size for Training Generative Adversarial Networks with Two Time-Scale Update Rule

Naoki Sato, Hideaki Iiduka

ICML 2023poster

Previous results have shown that a two time-scale update rule (TTUR) using different learning rates, such as different constant rates or different decaying rates, is useful for training generative adversarial networks (GANs) in theory and in practice. Moreover, not only the learning rate but also th…

Cited by 4 Source ↗PDF ↗code ↗Scholar ↗