What is: Sharpness-Aware Minimization?
Source | Sharpness-Aware Minimization for Efficiently Improving Generalization |
Year | 2000 |
Data Source | CC BY-SA - https://paperswithcode.com |
Sharpness-Aware Minimization, or SAM, is a procedure that improves model generalization by simultaneously minimizing loss value and loss sharpness. SAM functions by seeking parameters that lie in neighborhoods having uniformly low loss value (rather than parameters that only themselves have low loss value).