Viet-Anh on Software Logo

What is: Hierarchical Multi-Task Learning?

SourceDeep multi-task learning with low level tasks supervised at lower layers
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Multi-task learning (MTL) introduces an inductive bias, based on a-priori relations between tasks: the trainable model is compelled to model more general dependencies by using the abovementioned relation as an important data feature. Hierarchical MTL, in which different tasks use different levels of the deep neural network, provides more effective inductive bias compared to “flat” MTL. Also, hierarchical MTL helps to solve the vanishing gradient problem in deep learning.