Viet-Anh on Software Logo

What is: MaxUp?

SourceMaxUp: A Simple Way to Improve Generalization of Neural Network Training
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

MaxUp is an adversarial data augmentation technique for improving the generalization performance of machine learning models. The idea is to generate a set of augmented data with some random perturbations or transforms, and minimize the maximum, or worst case loss over the augmented data. By doing so, we implicitly introduce a smoothness or robustness regularization against the random perturbations, and hence improve the generation performance. For example, in the case of Gaussian perturbation, MaxUp is asymptotically equivalent to using the gradient norm of the loss as a penalty to encourage smoothness.