Viet-Anh on Software Logo

What is: Sparsemax?

SourceFrom Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Sparsemax is a type of activation/output function similar to the traditional softmax, but able to output sparse probabilities.

sparsemax(z)=arg_pΔK1minpz2\text{sparsemax}\left(z\right) = \arg\_{p∈\Delta^{K−1}}\min||\mathbf{p} - \mathbf{z}||^{2}