Learn Before
Relation

Pros and Cons of Parametric ReLU

Pros:

  • Allows the negative slope to be learned—unlike leaky ReLU, this function provides the slope of the negative part of the function as an argument. It is, therefore, possible to perform backpropagation and learn the most appropriate value of α.
  • Otherwise like ReLU

Cons:

  • May perform differently for different problems.

0

1

Updated 2020-06-25

Tags

Data Science