← Search

Umang Gupta

5 accepted papers

2024

VQ-TR: Vector Quantized Attention for Time Series Forecasting

ICLR 2024poster

Probabilistic time series forecasting is a challenging problem due to the long sequences involved, the large number of samples needed for accurate probabilistic inference, and the need for real-time inference in many applications. These challenges necessitate methods that are not only accurate but c…

Cited by 6SourcePDFScholar
2023

Jointly Reparametrized Multi-Layer Adaptation for Efficient and Private Tuning

ACL 2023findings

Efficient finetuning of pretrained language transformers is becoming increasingly prevalent for solving natural language processing tasks. While effective, it can still require a large number of tunable parameters. This can be a drawback for low-resource applications and training with differential-p…

2022

Estimating transfer entropy under long ranged dependencies

UAI 2022poster

Estimating Transfer Entropy (TE) between time series is a highly impactful problem in fields such as finance and neuroscience. The well-known nearest neighbor estimator of TE potentially fails if temporal dependencies are noisy and long ranged, primarily because it estimates TE indirectly relying o…

2022

Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal

ACL 2022findings

Language models excel at generating coherent text, and model compression techniques such as knowledge distillation have enabled their use in resource-constrained settings. However, these models can be biased in multiple ways, including the unfounded association of male and female genders with gender…

2021

Controllable Guarantees for Fair Outcomes via Contrastive Information Estimation

AAAI 2021technical

Controlling bias in training datasets is vital for ensuring equal treatment, or parity, between different groups in downstream applications. A naive solution is to transform the data so that it is statistically independent of group membership, but this may throw away too much information when a reas…