Viet-Anh on Software Logo

What is: EvoNorms?

SourceEvolving Normalization-Activation Layers
Year2000
Data SourceCC BY-SA - https://paperswithcode.com

EvoNorms are a set of normalization-activation layers that go beyond existing design patterns. Normalization and activation are unified into a single computation graph, its structure is evolved starting from low-level primitives. EvoNorms consist of two series: B series and S series. The B series are batch-dependent and were discovered by our method without any constraint. The S series work on individual samples, and were discovered by rejecting any batch-dependent operations.