Qinlan Shen

Don’t Just Clean It, Proxy Clean It: Mitigating Bias by Proxy in Pre-Trained Models

Transformer-based pre-trained models are known to encode societal biases not only in their contextual representations, but also in downstream predictions when fine-tuned on task-specific data.We present D-Bias, an approach that selectively eliminates stereotypical associations (e.g, co-occurrence st…