Viet-Anh on Software Logo

What is: Deep Equilibrium Models?

SourceDeep Equilibrium Models
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

A new kind of implicit models, where the output of the network is defined as the solution to an "infinite-level" fixed point equation. Thanks to this we can compute the gradient of the output without activations and therefore with a significantly reduced memory footprint.