Urban Knupleš

Gender Identity in Pretrained Language Models: An Inclusive Approach to Data Creation and Probing

Pretrained language models (PLMs) have been shown to encode binary gender information of text authors, raising the risk of skewed representations and downstream harms. This effect is yet to be examined for transgender and non-binary identities, whose frequent marginalization may exacerbate harmful s…