Viet-Anh on Software Logo

What is: Sharpness-Aware Minimization?

SourceSharpness-Aware Minimization for Efficiently Improving Generalization
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Sharpness-Aware Minimization, or SAM, is a procedure that improves model generalization by simultaneously minimizing loss value and loss sharpness. SAM functions by seeking parameters that lie in neighborhoods having uniformly low loss value (rather than parameters that only themselves have low loss value).