What is: Octave Convolution?
Source | Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution |
Year | 2000 |
Data Source | CC BY-SA - https://paperswithcode.com |
An Octave Convolution (OctConv) stores and process feature maps that vary spatially “slower” at a lower spatial resolution reducing both memory and computation cost. It takes in feature maps containing tensors of two frequencies one octave apart, and extracts information directly from the low-frequency maps without the need of decoding it back to the high-frequency. The motivation is that in natural images, information is conveyed at different frequencies where higher frequencies are usually encoded with fine details and lower frequencies are usually encoded with global structures.