Viet-Anh on Software Logo

What is: AdapTive Meta Optimizer?

SourceCombining Optimization Methods Using an Adaptive Meta Optimizer
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

This method combines multiple optimization techniques like ADAM and SGD or PADAM. This method can be applied to any couple of optimizers.

Image credit: Combining Optimization Methods Using an Adaptive Meta Optimizer