Discrete Representations

Stability Regularization for Discrete Representation Learning

We present a method for training neural network models with discrete stochastic variables. The core of the method is stability regularization, which is a regularization procedure based on the idea of noise stability developed in Gaussian …