Viet-Anh on Software Logo

What is: Location-based Attention?

SourceEffective Approaches to Attention-based Neural Machine Translation
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Location-based Attention is an attention mechanism in which the alignment scores are computed from solely the target hidden state h_t\mathbf{h}\_{t} as follows:

a_t=softmax(W_aht)\mathbf{a}\_{t} = \text{softmax}(\mathbf{W}\_{a}\mathbf{h}_{t})