**ENet Dilated Bottleneck** is an image model block used in the [ENet](https://paperswithcode.com/method/enet) semantic segmentation architecture. It is the same as a regular [ENet Bottleneck](https://paperswithcode.com/method/enet-bottleneck) but employs dilated convolutions instead.

**BigGAN** is a type of generative adversarial network that was designed for scaling generation to high-resolution, high-fidelity images. It includes a number of incremental changes and innovations. The baseline and incremental changes are:

- Using [SAGAN](https://paperswithcode.com/method/sagan) as a baseline with spectral norm. for G and D, and using [TTUR](https://paperswithcode.com/method/ttur).
- Using a Hinge Loss [GAN](https://paperswithcode.com/method/gan) objective
- Using class-[conditional batch normalization](https://paperswithcode.com/method/conditional-batch-normalization) to provide class information to G (but with linear projection not MLP.
- Using a [projection discriminator](https://paperswithcode.com/method/projection-discriminator) for D to provide class information to D.
- Evaluating with EWMA of G's weights, similar to ProGANs.

The innovations are:

- Increasing batch sizes, which has a big effect on the Inception Score of the model.
- Increasing the width in each layer leads to a further Inception Score improvement.
- Adding skip connections from the latent variable $z$ to further layers helps performance.
- A new variant of [Orthogonal Regularization](https://paperswithcode.com/method/orthogonal-regularization).

BigGAN

Large Scale GAN Training for High Fidelity Natural Image Synthesis

ENet Dilated Bottleneck

ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation

**Adaptive Input Embeddings** extend the [adaptive softmax](https://paperswithcode.com/method/adaptive-softmax) to input word representations. The factorization assigns more capacity to frequent words and reduces the capacity for less frequent words with the benefit of reducing overfitting to rare words.

Source	ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation
Year	2000
Data Source	CC BY-SA - https://paperswithcode.com