Khalid Benabdeslem

Debiasing Pretrained Text Encoders by Paying Attention to Paying Attention

Natural Language Processing (NLP) models are found to exhibit discriminatory stereotypes across many social constructs, e.g. gender and race. In comparison to the progress made in reducing bias from static word embeddings, fairness in sentence-level text encoders received little consideration despit…