Checkout
Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial
Question

Activation Function - What is the ELU activation function?

Answer

The Exponential Linear Unit (ELU) is another type of activation function used in neural networks. Unlike ReLUs, ELUs can have negative values, enabling them to push mean unit activations closer to zero. This is similar to batch normalization but with less computational demand.