Online Learning with Self-tuned Gaussian Kernels: Good Kernel-initialization by Multiscale Screening

Masa-aki Takizawa; Masahiro Yukawa

ICASSP 2019accepted0 citations

Online Learning with Self-tuned Gaussian Kernels: Good Kernel-initialization by Multiscale Screening

Abstract

We propose an efficient adaptive update method for the kernel parameters: the kernel coefficients, scales and centers. The mirror descent and the steepest descent method for squared error cost function are employed to update the kernel scales and centers, respectively. Although the problem considered in this paper is nonconvex, we reduce the possibility of falling into local minima by using a novel multiple initialization scheme to grow the dictionary without great increases of the dictionary size. Through computer experiments, we show that the proposed algorithm enjoys a high adaptation-capability while maintaining a small dictionary size, without detailed tuning of the initial kernel parameters.

BibTeX

@inproceedings{icassp2019_onlinelearningwi,
  title = {Online Learning with Self-tuned Gaussian Kernels: Good Kernel-initialization by Multiscale Screening},
  author = {Masa-aki Takizawa and Masahiro Yukawa},
  booktitle = {ICASSP 2019},
  year = {2019}
}