ICML 2016poster56 citations
Sparse Nonlinear Regression: Parameter Estimation under Nonconvexity
Zhuoran Yang, Zhaoran Wang, Han Liu, Yonina Eldar, Tong Zhang
Abstract
We study parameter estimation for sparse nonlinear regression. More specifically, we assume the data are given by y = f( \bf x^T \bf β^* ) + ε, where f is nonlinear. To recover \bf βs, we propose an \ell_1-regularized least-squares estimator. Unlike classical linear regression, the corresponding optimization problem is nonconvex because of the nonlinearity of f. In spite of the nonconvexity, we prove that under mild conditions, every stationary point of the objective enjoys an optimal statistical rate of convergence. Detailed numerical results are provided to back up our theory.
BibTeX
@InProceedings{pmlr-v48-yangc16,
title = {Sparse Nonlinear Regression: Parameter Estimation under Nonconvexity},
author = {Yang, Zhuoran and Wang, Zhaoran and Liu, Han and Eldar, Yonina and Zhang, Tong},
booktitle = {Proceedings of The 33rd International Conference on Machine Learning},
pages = {2472--2481},
year = {2016},
editor = {Balcan, Maria Florina and Weinberger, Kilian Q.},
volume = {48},
series = {Proceedings of Machine Learning Research},
address = {New York, New York, USA},
month = {20--22 Jun},
publisher = {PMLR},
pdf = {http://proceedings.mlr.press/v48/yangc16.pdf},
url = {https://proceedings.mlr.press/v48/yangc16.html},
abstract = {We study parameter estimation for sparse nonlinear regression. More specifically, we assume the data are given by y = f( \bf x^T \bf β^* ) + ε, where f is nonlinear. To recover \bf βs, we propose an \ell_1-regularized least-squares estimator. Unlike classical linear regression, the corresponding optimization problem is nonconvex because of the nonlinearity of f. In spite of the nonconvexity, we prove that under mild conditions, every stationary point of the objective enjoys an optimal statistical rate of convergence. Detailed numerical results are provided to back up our theory.}
}