Checkout
Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial
Question

Activation Function - Should I use sigmoid or ReLU?

Answer

ReLU is generally a better choice due to its efficiency. Besides avoiding the problem of vanishing gradients, ReLU's low computational complexity makes it run significantly faster than sigmoid functions.