Alexander Yun

Weight Updates as Activation Shifts: A Principled Framework for Steering

Activation steering promises to be an extremely parameter-efficient form of adaptation, but its effectiveness depends on critical design choices---such as intervention location and parameterization---that currently rely on empirical heuristics rather than a principled foundation. We establish a firs…