Viet-Anh on Software Logo

What is: Slanted Triangular Learning Rates?

SourceUniversal Language Model Fine-tuning for Text Classification
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Slanted Triangular Learning Rates (STLR) is a learning rate schedule which first linearly increases the learning rate and then linearly decays it, which can be seen in Figure to the right. It is a modification of Triangular Learning Rates, with a short increase and a long decay period.