https://www.nbshare.io/notebook/751082217/Activation-Functions-In-Python/

University of Minnesota - Twin Cities

Luckily it can be categorized into 2 types:

- Linear Activation Function

- Non-linear Activation Function

Types of Activation Function

Only one  function in the linear type. As the name says, the function will be linear. Ex: f(x) = x. Hence the output will not be confined into a range. Simply enough, it returns what it gets as input.

Linear Activation Function - Identity

- Sigmoid or Logistic Activation Function
- Tanh Activation Function
- ReLU (Rectified Linear Unit) Activation Function
- Softmax Activation Function

Learn Before

Related