← Search

Sheikh Shams Azam

4 accepted papers

2025

Enabling Differentially Private Federated Learning for Speech Recognition: Benchmarks, Adaptive Optimizers, and Gradient Clipping

NeurIPS 2025poster

While federated learning (FL) and differential privacy (DP) have been extensively studied, their application to automatic speech recognition (ASR) remains largely unexplored due to the challenges in training large transformer models. Specifically, large models further exacerbate issues in FL as they…

Cited by 0SourcecodeScholar
2022

Can we Generalize and Distribute Private Representation Learning?

AISTATS 2022poster

We study the problem of learning representations that are private yet informative i.e., provide information about intended "ally" targets while hiding sensitive "adversary" attributes. We propose Exclusion-Inclusion Generative Adversarial Network (EIGAN), a generalized private representation learnin…

2022

Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank?

ICLR 2022poster

In this paper, we question the rationale behind propagating large numbers of parameters through a distributed system during federated learning. We start by examining the rank characteristics of the subspace spanned by gradients (i.e., the gradient-space) in centralized model training, and observe th…