What is: Stable Rank Normalization?
Source | Stable Rank Normalization for Improved Generalization in Neural Networks and GANs |
Year | 2000 |
Data Source | CC BY-SA - https://paperswithcode.com |
Stable Rank Normalization (SRN) is a weight-normalization scheme which minimizes the stable rank of a linear operator. It simultaneously controls the Lipschitz constant and the stable rank of a linear operator. Stable rank is a softer version of the rank operator and is defined as the squared ratio of the Frobenius norm to the spectral norm.