Andrei Bachinin

Frictional Agent Alignment Framework: Slow Down and Don’t Break Things

AI support of collaborative interactions entails mediating potential misalignment between interlocutor beliefs. Common preference alignment methods like DPO excel in static settings, but struggle in dynamic collaborative tasks where the explicit signals of interlocutor beliefs are sparse and skewed.…