← Search

Swetasudha Panda

3 accepted papers

2022

Don’t Just Clean It, Proxy Clean It: Mitigating Bias by Proxy in Pre-Trained Models

EMNLP 2022finding

Transformer-based pre-trained models are known to encode societal biases not only in their contextual representations, but also in downstream predictions when fine-tuned on task-specific data.We present D-Bias, an approach that selectively eliminates stereotypical associations (e.g, co-occurrence st…

2022

Upstream Mitigation Is Not All You Need: Testing the Bias Transfer Hypothesis in Pre-Trained Language Models

ACL 2022long

A few large, homogenous, pre-trained models undergird many machine learning systems — and often, these models contain harmful stereotypes learned from the internet. We investigate the bias transfer hypothesis: the theory that social biases (such as stereotypes) internalized by large language models…

Cited by 92SourcePDFScholar