Viet-Anh on Software Logo

What is: Local Patch Interaction?

SourceXCiT: Cross-Covariance Image Transformers
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Local Patch Interaction, or LPI, is a module used for the XCiT layer to enable explicit communication across patches. LPI consists of two depth-wise 3×3 convolutional layers with Batch Normalization and GELU non-linearity in between. Due to its depth-wise structure, the LPI block has a negligible overhead in terms of parameters, as well as a limited overhead in terms of throughput and memory usage during inference.