Ali Aouad

The Sign Estimator: Preference Modeling for LLM Alignment under Heterogeneity

Traditional large language model (LLM) alignment methods are based on Reinforcement Learning From Human Feedback (RLHF), which learns a single reward model (implicitly or explicitly) from pairwise comparison data. This approach implicitly assumes homogeneous preferences across human labelers---an as…