Huiyan Xue

Distillation-Guided Structural Transfer for Continual Learning Beyond Sparse Distributed Memory

Sparse neural systems are gaining traction for efficient continual learning due to their modularity and low interference. Architectures like Sparse Distributed Memory Multi-Layer Perceptrons (SDMLP) construct task-specific subnetworks via Top-K activation and have shown resilience against catastroph