NeurIPS 2020poster76 citations

Outlier Robust Mean Estimation with Subgaussian Rates via Stability

Ilias Diakonikolas, Daniel M. Kane, Ankit Pensia

Abstract

We study the problem of outlier robust high-dimensional mean estimation under a bounded covariance assumption, and more broadly under bounded low-degree moment assumptions. We consider a standard stability condition from the recent robust statistics literature and prove that, except with exponentially small failure probability, there exists a large fraction of the inliers satisfying this condition. As a corollary, it follows that a number of recently developed algorithms for robust mean estimation, including iterative filtering and non-convex gradient descent, give optimal error estimators with (near-)subgaussian rates. Previous analyses of these algorithms gave significantly suboptimal rates. As a corollary of our approach, we obtain the first computationally efficient algorithm for outlier robust mean estimation with subgaussian rates under a bounded covariance assumption.

BibTeX
@inproceedings{NEURIPS2020_13ec9935,
 author = {Diakonikolas, Ilias and Kane, Daniel M. and Pensia, Ankit},
 booktitle = {Advances in Neural Information Processing Systems},
 editor = {H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin},
 pages = {1830--1840},
 publisher = {Curran Associates, Inc.},
 title = {Outlier Robust Mean Estimation with Subgaussian Rates via Stability},
 url = {https://proceedings.neurips.cc/paper_files/paper/2020/file/13ec9935e17e00bed6ec8f06230e33a9-Paper.pdf},
 volume = {33},
 year = {2020}
}