Pros:

• Whereas with ReLU, all negative outputs go to zero, ELU can produce negative outputs
• Tends to converge cost to zero very quickly and produce very accurate results
• Additional parameter alpha. ELU becomes smooth slowly until its output equal to -α whereas RELU sharply smoothes

Cons:

• For x > 0, it can blow up the activation with the output range of 0 -> infinity