Sophia S. Lee

Do language models practice what they preach? Examining language ideologies about gendered language reform encoded in LLMs

We study language ideologies in text produced by LLMs through a case study on English gendered language reform (related to role nouns like congressperson/-woman/-man, and singular they). First, we find political bias: when asked to use language that is “correct” or “natural”, LLMs use language most…