Bottleneck#

top

We denote by bottleneck the type of representation \(\mathbf{z}\) (and paradigm used) in an auto-encoder \(\hat{\mathbf{x}}=g_{\phi}(\mathbf{z}), \mathbf{z}=f_{\theta}(\mathbf{x})\): such as continuous deterministic, continuous probabilist, quantized, residual.

Auto-encoder#

Variational auto-encoder (VAE)#

Vector Quantised-Variational AutoEncoder (VQ-VAE)#

Residual Vector Quantizers (RVQ)#

Soundstream