What is: Distributed Any-Batch Mirror Descent?
Year | 2020 |
Data Source | CC BY-SA - https://paperswithcode.com |
Distributed Any-Batch Mirror Descent (DABMD) is based on distributed Mirror Descent but uses a fixed per-round computing time to limit the waiting by fast nodes to receive information updates from slow nodes. DABMD is characterized by varying minibatch sizes across nodes. It is applicable to a broader range of problems compared with existing distributed online optimization methods such as those based on dual averaging, and it accommodates time-varying network topology.