2022
Fast and Robust Online Inference with Stochastic Gradient Descent via Random Scaling
AAAI 2022technical
We develop a new method of online inference for a vector of parameters estimated by the Polyak-Ruppert averaging procedure of stochastic gradient descent (SGD) algorithms. We leverage insights from time series regression in econometrics and construct asymptotically pivotal statistics via random scal…