What is: ResNeXt?
Source | Aggregated Residual Transformations for Deep Neural Networks |
Year | 2000 |
Data Source | CC BY-SA - https://paperswithcode.com |
A ResNeXt repeats a building block that aggregates a set of transformations with the same topology. Compared to a ResNet, it exposes a new dimension, cardinality (the size of the set of transformations) , as an essential factor in addition to the dimensions of depth and width.
Formally, a set of aggregated transformations can be represented as: , where can be an arbitrary function. Analogous to a simple neuron, should project into an (optionally low-dimensional) embedding and then transform it.