Learn Before
Concept
Relational Knowledge Distillation
The student network is learned by feature embedding, and relations between data samples are modeled as probabilistic distribution using feature representations of data. The teacher and student probability distributions are matched by knowledge transfer. (Peng et al. (2019)).
0
1
Updated 2022-10-22
Tags
Deep Learning (in Machine learning)
Data Science