Viet-Anh on Software Logo

What is: Serf?

SourceSERF: Towards better training of deep neural networks using log-Softplus ERror activation Function
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Serf, or Log-Softplus ERror activation Function, is a type of activation function which is self-regularized and nonmonotonic in nature. It belongs to the Swish family of functions. Serf is defined as:

f(x)=xerf(ln(1+ex))f\left(x\right) = x\text{erf}\left(\ln\left(1 + e^{x}\right)\right)