The **Rectified Linear Unit N**, or **ReLUN**, is a modification of **[ReLU6](https://paperswithcode.com/method/relu6)** activation function that has trainable parameter **n**.

$$ReLUN(x) = min(max(0, x), n)$$

**GrowNet** is a novel approach to combine the power of gradient boosting to incrementally build complex deep neural networks out of shallow components. It introduces a versatile framework that can readily be adapted for a diverse range of machine learning tasks in a wide variety of domains.

GrowNet

Gradient Boosting Neural Networks: GrowNet

ReLUN

Trainable Activations for Image Classification

ComplEx model trained with a nuclear norm regularizer

Source	Trainable Activations for Image Classification
Year	2000
Data Source	CC BY-SA - https://paperswithcode.com