Viet-Anh on Software Logo

What is: BAGUA?

SourceBAGUA: Scaling up Distributed Learning with System Relaxations
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

BAGUA is a communication framework whose design goal is to provide a system abstraction that is both flexible and modular to support state-of-the-art system relaxation techniques of distributed training. The abstraction goes beyond parameter server and Allreduce paradigms, and provides a collection of MPI-style collective operations to facilitate communications with different precision and centralization strategies.