← Search

Pramod Varshney

3 accepted papers

2022

Federated Minimax Optimization: Improved Convergence Analyses and Algorithms

ICML 2022spotlight

In this paper, we consider nonconvex minimax optimization, which is gaining prominence in many modern machine learning applications, such as GANs. Large-scale edge-based collection of training data in these applications calls for communication-efficient distributed optimization algorithms, such as t…

Cited by 62SourcePDFScholar
2022

Learning Distributions Generated by Single-Layer ReLU Networks in the Presence of Arbitrary Outliers

NeurIPS 2022accept

We consider a set of data samples such that a fraction of the samples are arbitrary outliers, and the rest are the output samples of a single-layer neural network with rectified linear unit (ReLU) activation. Our goal is to estimate the parameters (weight matrix and bias vector) of the neural networ…

Cited by 0SourcePDFScholar
2021

STEM: A Stochastic Two-Sided Momentum Algorithm Achieving Near-Optimal Sample and Communication Complexities for Federated Learning

NeurIPS 2021poster

Federated Learning (FL) refers to the paradigm where multiple worker nodes (WNs) build a joint model by using local data. Despite extensive research, for a generic non-convex FL problem, it is not clear, how to choose the WNs' and the server's update directions, the minibatch sizes, and the local up…

Cited by 73SourcePDFScholar