Rectified Linear Unit - Why is Gelu better than ReLU?

While ReLU is easier to compute, GeLu has the clear benefit of preventing overfitting. The reason behind this is because neurons with negative values are more effectively processed by GeLu.