Concept

Multi-Layer Perceptron (MLP)

We can take the weights from the DBN and use them to define an MLP: h(1)=σ(b(1)+vW(1))h^{(1)} = \sigma (b^{(1)} + v^{\top}W^{(1)}) h(1)=σ(b(1)+h(l1)W(l))l2,...,mh^{(1)} = \sigma (b^{(1)} + h^{(l-1)\top}W^{(l)})\forall l \in 2, ..., m After initialization, we can train the MLP to perform a classification task, which is an example of discriminative fine-tuning.

0

1

Updated 2021-07-22

References


Tags

Data Science

Related