Checkout
Personalized AI apps
Build multi-agent systems without code and automate document search, RAG and content generation
Start free trial
Question

Batch Normalization - Can batch normalization hurt?

Answer

Because the batch size is not consistent between iterations when using batch normalization, the input data's scale and shift are not well generalized, which might negatively impact performance.