Michal Kempka

Adaptive Scale-Invariant Online Algorithms for Learning Linear Models

We consider online learning with linear models, where the algorithm predicts on sequentially revealed instances (feature vectors), and is compared against the best linear function (comparator) in hindsight. Popular algorithms in this framework, such as Online Gradient Descent (OGD), have parameters…