ICML 2016poster159 citations
SDCA without Duality, Regularization, and Individual Convexity
Abstract
Stochastic Dual Coordinate Ascent is a popular method for solving regularized loss minimization for the case of convex losses. We describe variants of SDCA that do not require explicit regularization and do not rely on duality. We prove linear convergence rates even if individual loss functions are non-convex, as long as the expected loss is strongly convex.
BibTeX
@InProceedings{pmlr-v48-shalev-shwartza16,
title = {SDCA without Duality, Regularization, and Individual Convexity},
author = {Shalev-Shwartz, Shai},
booktitle = {Proceedings of The 33rd International Conference on Machine Learning},
pages = {747--754},
year = {2016},
editor = {Balcan, Maria Florina and Weinberger, Kilian Q.},
volume = {48},
series = {Proceedings of Machine Learning Research},
address = {New York, New York, USA},
month = {20--22 Jun},
publisher = {PMLR},
pdf = {http://proceedings.mlr.press/v48/shalev-shwartza16.pdf},
url = {https://proceedings.mlr.press/v48/shalev-shwartza16.html},
abstract = {Stochastic Dual Coordinate Ascent is a popular method for solving regularized loss minimization for the case of convex losses. We describe variants of SDCA that do not require explicit regularization and do not rely on duality. We prove linear convergence rates even if individual loss functions are non-convex, as long as the expected loss is strongly convex.}
}