Djordje Batic

Improving Knowledge Distillation for Non-Intrusive Load Monitoring Through Explainability Guided Learning

Knowledge distillation (KD) is a machine learning technique widely used in recent years for the task of domain adaptation and complexity reduction. It relies on a Student-Teacher mechanism to transfer the knowledge of a large and complex Teacher network into a smaller Student model. Given the inhere…