Zehui Jiang

Neuron Empirical Gradient: Discovering and Quantifying Neurons’ Global Linear Controllability

While feed-forward neurons in pre-trained language models (PLMs) can encode knowledge, past research targeted a small subset of neurons that heavily influence outputs.This leaves the broader role of neuron activations unclear, limiting progress in areas like knowledge editing.We uncover a global lin…