Gradient Estimation Articles

Page 1 of 1 (2 articles)

12/2/2025 • EN

Random Search for Random Search

A technical lecture on applying policy gradient methods to derive optimization algorithms, focusing on the unbiased gradient estimator and its applications.

Gradient Estimation Machine Learning Policy Gradient Reinforcement Learning Stochastic Optimization

Ben Recht

7/16/2018 • EN

Neural Networks gone wild! They can sample from discrete distributions now!

Explains the Gumbel-Softmax trick, a method for training neural networks that need to sample from discrete distributions, enabling gradient flow.

Gradient Estimation Monte Carlo Neural Networks Reparameterization Trick Variational Autoencoder

Yoel Zeldes

Gradient Estimation Articles

Random Search for Random Search

Neural Networks gone wild! They can sample from discrete distributions now!

Select Language