Nuri Vanli

When Cyclic Coordinate Descent Outperforms Randomized Coordinate Descent

The coordinate descent (CD) method is a classical optimization algorithm that has seen a revival of interest because of its competitive performance in machine learning applications. A number of recent papers provided convergence rate estimates for their deterministic (cyclic) and randomized variants…