Viet-Anh on Software Logo

What is: Dual Path Network?

SourceDual Path Networks
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

A Dual Path Network (DPN) is a convolutional neural network which presents a new topology of connection paths internally. The intuition is that ResNets enables feature re-usage while DenseNet enables new feature exploration, and both are important for learning good representations. To enjoy the benefits from both path topologies, Dual Path Networks share common features while maintaining the flexibility to explore new features through dual path architectures.

We formulate such a dual path architecture as follows:

xk=_t=1k1f_tk(ht),x^{k} = \sum\limits\_{t=1}^{k-1} f\_t^{k}(h^t) \text{,}

yk=_t=1k1v_t(ht)=yk1+ϕk1(yk1),y^{k} = \sum\limits\_{t=1}^{k-1} v\_t(h^t) = y^{k-1} + \phi^{k-1}(y^{k-1}) \text{,} \\\\
rk=xk+yk,r^{k} = x^{k} + y^{k} \text{,} \\\\
hk=gk(rk),h^k = g^k \left( r^{k} \right) \text{,}

where xkx^{k} and yky^{k} denote the extracted information at kk-th step from individual path, vt()v_t(\cdot) is a feature learning function as ftk()f_t^k(\cdot). The first equation refers to the densely connected path that enables exploring new features. The second equation refers to the residual path that enables common features re-usage. The third equation defines the dual path that integrates them and feeds them to the last transformation function in the last equation.