2025
Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
AAAI 2025technical
Current knowledge distillation (KD) methods for semantic segmentation focus on guiding the student to imitate the teacher's knowledge within homogeneous architectures. However, these methods overlook the diverse knowledge contained in architectures with different inductive biases, which is crucial f…