3 Comments
User's avatar
Ignacio Cabrero's avatar

Great

Expand full comment
Vincent Rainardi's avatar

It is a very clear and useful article. Thank you.

Expand full comment
User's avatar
Comment deleted
Mar 17, 2024
Comment deleted
Expand full comment
Avi Chawla's avatar

yes, it maintains a exponentially decaying average of the previously computed gradients.

Expand full comment