Viet-Anh on Software Logo

What is: ProxylessNAS?

SourceProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

ProxylessNAS directly learns neural network architectures on the target task and target hardware without any proxy task. Additional contributions include:

  • Using a new path-level pruning perspective for neural architecture search, showing a close connection between NAS and model compression. Memory consumption is saved by one order of magnitude by using path-level binarization.
  • Using a novel gradient-based approach (latency regularization loss) for handling hardware objectives (e.g. latency). Given different hardware platforms: CPU/GPU/Mobile, ProxylessNAS enables hardware-aware neural network specialization that’s exactly optimized for the target hardware.