Stochastic Approximation and Recursive Algorithms and Applications

Difference between Stochastic Approximation (SA) and Stochastic Gradient Descent (SGD)

Posted by flxh, at stats.stackexchange.com, 17 Jan 2018

I understand the intended use cases for both stochastic approximation algorithms like SPSA or FDSA, and for SGD algorithms like…