← Search

Steven Z. Wu

9 accepted papers

2020

Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithms

NeurIPS 2020poster

Recently, there is a growing interest in the study of median-based algorithms for distributed non-convex optimization. Two prominent examples include signSGD with majority vote, an effective approach for communication reduction via 1-bit compression on the local gradients, and medianSGD, an algorith…

Cited by 83SourcePDFScholar
2020

Understanding Gradient Clipping in Private SGD: A Geometric Perspective

NeurIPS 2020spotlight

Deep learning models are increasingly popular in many machine learning applications where the training data may contain sensitive information. To provide formal and rigorous privacy guarantee, many learning systems now incorporate differential privacy by training their models with (differentially) p…

Cited by 246SourcePDFScholar
2019

Equal Opportunity in Online Classification with Partial Feedback

NeurIPS 2019poster

We study an online classification problem with partial feedback in which individuals arrive one at a time from a fixed but unknown distribution, and must be classified as positive or negative. Our algorithm only observes the true label of an individual if they are given a positive classification. Th…

Cited by 71SourcePDFScholar
2019

Random Quadratic Forms with Dependence: Applications to Restricted Isometry and Beyond

NeurIPS 2019poster

Several important families of computational and statistical results in machine learning and randomized algorithms rely on uniform bounds on quadratic forms of random vectors or matrices. Such results include the Johnson-Lindenstrauss (J-L) Lemma, the Restricted Isometry Property (RIP), randomized sk…

Cited by 6SourcePDFScholar
2017

Accuracy First: Selecting a Differential Privacy Level for Accuracy Constrained ERM

NeurIPS 2017poster

Traditional approaches to differential privacy assume a fixed privacy requirement ε for a computation, and attempt to maximize the accuracy of the computation subject to the privacy constraint. As differential privacy is increasingly deployed in practical settings, it may often be that there is inst…

Cited by 116SourcePDFScholar
2016

Learning from Rational Behavior: Predicting Solutions to Unknown Linear Programs

NeurIPS 2016poster

We define and study the problem of predicting the solution to a linear program (LP) given only partial information about its objective and constraints. This generalizes the problem of learning to predict the purchasing behavior of a rational agent who has an unknown objective function, that has been…

Cited by 15SourcePDFScholar