Viet-Anh on Software Logo

What is: Legendre Memory Unit?

SourceLegendre Memory Units: Continuous-Time Representation in Recurrent Neural Networks
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

The Legendre Memory Unit (LMU) is mathematically derived to orthogonalize its continuous-time history – doing so by solving d coupled ordinary differential equations (ODEs), whose phase space linearly maps onto sliding windows of time via the Legendre polynomials up to degree d-1. It is optimal for compressing temporal information.

See paper for equations (markdown isn't working).

Official github repo: https://github.com/abr/lmu