Viet-Anh on Software Logo

What is: Channel-wise Soft Attention?

Year2017
Data SourceCC BY-SA - https://paperswithcode.com

Channel-wise Soft Attention is an attention mechanism in computer vision that assigns "soft" attention weights for each channel cc. In soft channel-wise attention, the alignment weights are learned and placed "softly" over each channel. This would contrast with hard attention which would only selects one channel to attend to at a time.

Image: Xu et al