Viet-Anh on Software Logo

What is: Linear Combination of Activations?

SourceTrainable Activations for Image Classification
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

The Linear Combination of Activations, or LinComb, is a type of activation function that has trainable parameters and uses the linear combination of other activation functions.

LinComb(x)=i=0nwiFi(x)LinComb(x) = \sum\limits_{i=0}^{n} w_i \mathcal{F}_i(x)