Viet-Anh on Software Logo

What is: Self-adaptive Training?

SourceSelf-Adaptive Training: beyond Empirical Risk Minimization
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Self-adaptive Training is a training algorithm that dynamically corrects problematic training labels by model predictions to improve generalization of deep learning for potentially corrupted training data. Accumulated predictions are used to augment the training dynamics. The use of an exponential-moving-average scheme alleviates the instability issue of model predictions, smooths out the training target during the training process and enables the algorithm to completely change the training labels if necessary.