All Should Be Equal in the Eyes of LMs: Counterfactually Aware Fair Text Generation
Fairness in Language Models (LMs) remains a long-standing challenge, given the inherent biases in training data that can be perpetuated by models and affect the downstream tasks. Recent methods employ expensive retraining or attempt debiasing during inference by constraining model outputs to contras…