Learn Before
Concept

Relational Knowledge Distillation

The student network is learned by feature embedding, and relations between data samples are modeled as probabilistic distribution using feature representations of data. The teacher and student probability distributions are matched by knowledge transfer. (Peng et al. (2019)).

0

1

Updated 2022-10-22

Tags

Deep Learning (in Machine learning)

Data Science