Hongkai Liu

From Backward Spreading to Forward Replay: Revisiting Target Construction in LLM Parameter Editing

LLM parameter editing methods commonly rely on computing an ideal target hidden-state at a target layer (referred as anchor point) and distributing the target vector to multiple preceding layers (commonly known as backward spreading) for cooperative editing. Although widely used for a long time, its…