generative model

On Measuring and Controlling the Spectral Bias of the Deep Image Prior

The deep image prior showed that a randomly initialized network with a suitable architecture can be trained to solve inverse imaging problems by simply optimizing it's parameters to reconstruct a single degraded image. However, it suffers from two …

Spectral Smoothing Unveils Phase Transitions in Hierarchical Variational Autoencoders

Variational autoencoders with deep stochastic hierarchies are known to suffer from the problem of posterior collapse, where the top layers fall back to the prior and become independent of input. We suggest that the hierarchical VAE objective …

Categorical Normalizing Flows via Continuous Transformations

Despite their popularity, to date, the application of normalizing flows on categorical data stays limited. The current practice of using dequantization to map discrete data to a continuous space is inapplicable as categorical data has no intrinsic …