2026
Data Selection for LLM Alignment Using Fine-Grained Preferences
ICLR 2026poster
Large language models (LLMs) alignment aims to ensure that the behavior of LLMs meets human preferences. While collecting data from multiple fine-grained, aspect-specific preferences becomes more and more feasible, existing alignment methods typically work on a single preference and thus struggle wi…