A Dynamical Systems Perspective on Online Bayesian Nonparametric Estimators with Adaptive Hyperparameters
This paper presents and analyzes constant step size stochastic gradient algorithms in reproducing kernel Hilbert Space (RKHS), which encapsulates various adaptive nonlinear interpolation schemes. The hyperparameters of the function iterates are updated via a distribution that depends on the estimate…