· ai
[Paper] CanKD: Cross-Attention-based Non-local operation for Feature-based Knowledge Distillation
We propose Cross-Attention-based Non-local Knowledge Distillation (CanKD), a novel feature-based knowledge distillation framework that leverages cross-attention...