**CSPResNeXt** is a convolutional neural network where we apply the Cross Stage Partial Network (CSPNet) approach to [ResNeXt](https://paperswithcode.com/method/resnext). The CSPNet partitions the feature map of the base layer into two parts and then merges them through a cross-stage hierarchy. The use of a split and merge strategy allows for more gradient flow through the network.

**Distributed Any-Batch Mirror Descent** (DABMD) is based on distributed Mirror Descent but uses a fixed per-round computing time to limit the waiting by fast nodes to receive information updates from slow nodes. DABMD is characterized by varying minibatch sizes across nodes. It is applicable to a broader range of problems compared with existing distributed online optimization methods such as those based on dual averaging, and it accommodates time-varying network topology.

DABMD

CSPResNeXt

CSPNet: A New Backbone that can Enhance Learning Capability of CNN

The **DELU** is a type of activation function that has trainable parameters, uses the complex linear and exponential functions in the positive dimension and uses the **[SiLU](https://paperswithcode.com/method/silu)** in the negative dimension.

$$DELU(x) = SiLU(x), x \leqslant 0$$
$$DELU(x) = (n + 0.5)x + |e^{-x} - 1|, x > 0$$

Source	CSPNet: A New Backbone that can Enhance Learning Capability of CNN
Year	2000
Data Source	CC BY-SA - https://paperswithcode.com