Avoid ReLU when dealing with negative values or vanishing gradients.

• When dealing with negative values, use Leaky ReLU or ELU instead.

• When facing vanishing gradients, use other activation functions lik...read more