Viet-Anh on Software Logo

What is: Gradient Harmonizing Mechanism C?

SourceGradient Harmonized Single-stage Detector
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

GHM-C is a loss function designed to balance the gradient flow for anchor classification. The GHM first performs statistics on the number of examples with similar attributes w.r.t their gradient density and then attaches a harmonizing parameter to the gradient of each example according to the density. The modification of gradient can be equivalently implemented by reformulating the loss function. Embedding the GHM into the classification loss is denoted as GHM-C loss. Since the gradient density is a statistical variable depending on the examples distribution in a mini-batch, GHM-C is a dynamic loss that can adapt to the change of data distribution in each batch as well as to the updating of the model.