WINA: Weight Informed Neuron Activation for Accelerating Large Language Model Inference
The ever-increasing computational demands of large language models (LLMs) make efficient inference a central challenge. While recent advances leverage specialized architectures or selective activation, they typically require (re)training or architectural modifications, limiting their broad applicabi…