Viet-Anh on Software Logo

What is: Non-Local Block?

SourceNon-local Neural Networks
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

A Non-Local Block is an image block module used in neural networks that wraps a non-local operation. We can define a non-local block as:

z_i=W_zy_i+x_i\mathbb{z}\_{i} = W\_{z}\mathbb{y\_{i}} + \mathbb{x}\_{i}

where y_iy\_{i} is the output from the non-local operation and +x_i+ \mathbb{x}\_{i} is a residual connection.