The problem with a step function is that it does not allow multi-value outputs—for example, it cannot support classifying the inputs into one of several categories.

It also doesn't reflect the confidence of each prediction (as opposed to a logistic function that reflects confidence by giving a probability of how close you are to one of the two outputs).

It is not recommended to use in hidden layer because it's doesn't have derivate learning value