3 Comments
User's avatar
Ignacio Cabrero's avatar

Great

Vincent Rainardi's avatar

It is a very clear and useful article. Thank you.

User's avatar
Comment deleted
Mar 17, 2024
Comment deleted
Avi Chawla's avatar

yes, it maintains a exponentially decaying average of the previously computed gradients.