Viet-Anh on Software Logo

What is: Lifelong Infinite Mixture?

SourceLifelong Infinite Mixture Model Based on Knowledge-Driven Dirichlet Process
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

LIMix, or Lifelong Infinite Mixture, is a lifelong learning model which grows a mixture of models to adapt to an increasing number of tasks. LIMix can automatically expand its network architectures or choose an appropriate component to adapt its parameters for learning a new task, while preserving its previously learnt information. Knowledge is incorporated by means of Dirichlet processes by using a gating mechanism which computes the dependence between the knowledge learnt previously and stored in each component, and a new set of data. Besides, a Student model is trained which can accumulate cross-domain representations over time and make quick inferences.