Viet-Anh on Software Logo

What is: Soft Split and Soft Composition?

SourceFuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Soft Split and Soft Composition are video frame based operations used in the FuseFormer architecture, specifically the FuseFormer blocks. We softly split each frame into overlapped patches and then softly composite them back, by using an unfold and fold operator with patch size kk being greater than patch stride ss. When compositing patches back to its original spatial shape, we add up feature values at each overlapping spatial location of neighboring patches.