Viet-Anh on Software Logo

What is: Decorrelated Batch Normalization?

SourceDecorrelated Batch Normalization
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Decorrelated Batch Normalization (DBN) is a normalization technique which not just centers and scales activations but whitens them. ZCA whitening instead of PCA whitening is employed since PCA whitening causes a problem called stochastic axis swapping, which is detrimental to learning.