Fairness Perceptions of Large Language Models
Benjamin Cookson, Soroush Ebadian, Nisarg Shah
Abstract
Large language models (LLMs) are increasingly used for decision-making tasks where fairness is an essential desideratum. But what does fairness even mean to an LLM? To investigate this, we conduct a comprehensive evaluation of how LLMs perceive fairness in the context of resource allocation, using both synthetic and real-world data. We find that several state-of-the-art LLMs, when instructed to be fair, tend to prioritize improving collective welfare rather than distributing benefits equally. Their perception of fairness is somewhat sensitive to how user preferences are represented, but less so to the real-world context of the decision-making task. Finally, we show that the best strategy for aligning an LLM
BibTeX
@inproceedings{aaai2026_fairnesspercepti,
title = {Fairness Perceptions of Large Language Models},
author = {Benjamin Cookson and Soroush Ebadian and Nisarg Shah},
booktitle = {AAAI 2026},
year = {2026}
}