Viet-Anh on Software Logo

What is: SongNet?

SourceSongNet: Rigid Formats Controlled Text Generation
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

SongNet is an auto-regressive Transformer-based language model for rigid format text detection. Sets of symbols are tailor-designed to improve the modeling performance especially on format, rhyme, and sentence integrity. The attention mechanism is improved to impel the model to capture some future information on the format. A pre-training and fine-tuning framework is designed to further improve the generation quality.