Jiaxuan Cheng

Local Redundancy: An Information-Theoretic Measure of Plasticity from Synthetic Memorization

Plasticity—a neural network's ability to adapt to new tasks—is critical for continual and transfer learning. Existing measures, such as effective rank, dead neuron fraction, and weight norm, lack theoretical grounding and correlate poorly with performance on new tasks. We introduce *local redundancy…