Viet-Anh on Software Logo

What is: Highway Network?

SourceHighway Networks
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

A Highway Network is an architecture designed to ease gradient-based training of very deep networks. They allow unimpeded information flow across several layers on "information highways". The architecture is characterized by the use of gating units which learn to regulate the flow of information through a network. Highway networks with hundreds of layers can be trained directly using stochastic gradient descent and with a variety of activation functions.