Introduction to Adam Optimizer & advancements leading to it
Published
Cite this post:Ramith Hettiarachchi (2022, March 9). Introduction to Adam Optimizer & advancements leading to it. ramith.fyi. https://ramith.fyi/posts/2022-03-09-intro-to-optimizers/.
This is a presentation I gave at one of the Journal Club meetings in the computational imaging group at Harvard (Wadduwage Lab).
It covers how full-batch gradient descent [1] evolved into the Adam optimizer [2] as researchers addressed practical optimization challenges.
You can download the slides below. π
KUDOSDonβt
MoveThanks!
Comments
Join the conversation with your GitHub account.