BDCKD: Unlocking the Power of Brownian Distance Covariance in Knowledge Distillation
Knowledge distillation has been proven to be an effective method for enhancing model performance, particularly in the domain of model compression. In this study, we propose a comprehensive approach that utilizes Brownian Distance Covariance (BDC) to measure the discrepancy between the logits produce…