Viet-Anh on Software Logo

What is: Stable Rank Normalization?

SourceStable Rank Normalization for Improved Generalization in Neural Networks and GANs
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Stable Rank Normalization (SRN) is a weight-normalization scheme which minimizes the stable rank of a linear operator. It simultaneously controls the Lipschitz constant and the stable rank of a linear operator. Stable rank is a softer version of the rank operator and is defined as the squared ratio of the Frobenius norm to the spectral norm.