← Search

Harvineet Singh

6 accepted papers

2025

"Who experiences large model decay and why?" A Hierarchical Framework for Diagnosing Heterogeneous Performance Drift

ICML 2025poster

Machine learning (ML) models frequently experience performance degradation when deployed in new contexts. Such degradation is rarely uniform: some subgroups may suffer large performance decay while others may not. Understanding where and how large differences in performance arise is critical for des…

Cited by 0SourcePDFScholar
2024

A hierarchical decomposition for explaining ML performance discrepancies

NeurIPS 2024poster

Machine learning (ML) algorithms can often differ in performance across domains. Understanding why their performance differs is crucial for determining what types of interventions (e.g., algorithmic or operational) are most effective at closing the performance gaps. Aggregate decompositions express…

Cited by 2SourcePDFScholar
2023

"Why did the Model Fail?": Attributing Model Performance Changes to Distribution Shifts

ICML 2023poster

Machine learning models frequently experience performance drops under distribution shifts. The underlying cause of such shifts may be multiple simultaneous factors such as changes in data quality, differences in specific covariate distributions, or changes in the relationship between label and featu…

2023

When do Minimax-fair Learning and Empirical Risk Minimization Coincide?

ICML 2023poster

Minimax-fair machine learning minimizes the error for the worst-off group. However, empirical evidence suggests that when sophisticated models are trained with standard empirical risk minimization (ERM), they often have the same performance on the worst-off group as a minimax-trained model. Our work…

Cited by 5SourcePDFScholar
2022

Data poisoning attacks on off-policy policy evaluation methods

UAI 2022poster

Off-policy Evaluation (OPE) methods are a crucial tool for evaluating policies in high-stakes domains such as healthcare, where exploration is often infeasible, unethical, or expensive. However, the extent to which such methods can be trusted under adversarial threats to data quality is largely unex…

Cited by 2SourcePDFScholar
2019

Cascading Linear Submodular Bandits: Accounting for Position Bias and Diversity in Online Learning to Rank

UAI 2019poster

Online learning, position bias, and diversified retrieval are three crucial aspects in designing ranking systems based on user clicks. One simple click model which explains the position bias is the cascade model. Many online learning variants of the cascade model have been proposed, but none so far…

Cited by 32SourcePDFScholar