Viet-Anh on Software Logo

What is: ByteScheduler?

Year2019
Data SourceCC BY-SA - https://paperswithcode.com

ByteScheduler is a generic communication scheduler for distributed DNN training acceleration. It is based on analysis that partitioning and rearranging the tensor transmissions can result in optimal results in theory and good performance in real-world even with scheduling overhead.