Rahul Zalkikar

Measuring Social Biases in Masked Language Models by Proxy of Prediction Quality

Innovative transformer-based language models produce contextually-aware token embeddings and have achieved state-of-the-art performance for a variety of natural language tasks, but have been shown to encode unwanted biases for downstream applications. In this paper, we evaluate the social biases enc…