Checkout
Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial
Question

Batch Normalization - Why does batch normalization reduce overfitting?

Answer

Batch normalization preserves more information in the weights by allowing the network to use lower weight decay values without significantly diminishing the regularization impact. The network becomes less prone to co-adaptation and overfitting as a result of reduced feature correlation.