**DropAttack** is an adversarial training method that adds intentionally worst-case adversarial perturbations to both the input and hidden layers in different dimensions and minimizes the adversarial risks generated by each layer.

**AutoSync** is a pipeline for automatically optimizing synchronization strategies, given model structures and resource specifications, in data-parallel distributed machine learning. By factorizing the synchronization strategy with respect to each trainable building block of a DL model, we can construct a valid and large strategy space spanned by multiple factors. AutoSync efficiently navigates the space and locates the optimal strategy. AutoSync leverages domain knowledge about synchronization systems to reduce the search space, and is equipped with a domain adaptive simulator, which combines principled communication modeling and data-driven ML models, to estimate the runtime of strategy proposals without launching real distributed execution.

AutoSync

AutoSync: Learning to Synchronize for Data-Parallel Distributed Deep Learning

DropAttack

DropAttack: A Masked Weight Adversarial Training Method to Improve Generalization of Neural Networks

Please enter a description about the method here

Source	DropAttack: A Masked Weight Adversarial Training Method to Improve Generalization of Neural Networks
Year	2000
Data Source	CC BY-SA - https://paperswithcode.com

Viet-Anh on Software

What is: DropAttack?

Viet-Anh on Software