Viet-Anh on Software Logo

What is: Collaborative Distillation?

SourceCollaborative Distillation for Ultra-Resolution Universal Style Transfer
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Collaborative Distillation is a new knowledge distillation method (named Collaborative Distillation) for encoder-decoder based neural style transfer to reduce the number of convolutional filters. The main idea is underpinned by a finding that the encoder-decoder pairs construct an exclusive collaborative relationship, which is regarded as a new kind of knowledge for style transfer models.