3 Comments

Great

Expand full comment

It is a very clear and useful article. Thank you.

Expand full comment
Comment deleted
Mar 17
Comment deleted
Expand full comment

yes, it maintains a exponentially decaying average of the previously computed gradients.

Expand full comment