Learn Before
Relation
Pros and Cons of Parametric ReLU
Pros:
- Allows the negative slope to be learned—unlike leaky ReLU, this function provides the slope of the negative part of the function as an argument. It is, therefore, possible to perform backpropagation and learn the most appropriate value of α.
- Otherwise like ReLU
Cons:
- May perform differently for different problems.
0
1
Updated 2020-06-25
Tags
Data Science