Gradient Estimation

Low Bias Low Variance Gradient Estimates for Boolean Stochastic Networks

Stochastic neural networks with discrete random variables are an important class of models for their expressiveness and interpretability. Since direct differentiation and backpropagation is not possible, Monte Carlo gradient estimation techniques are …