Introduction to Adam Optimizer & advancements leading to it

Published

Cite this post:Ramith Hettiarachchi (2022, March 9). Introduction to Adam Optimizer & advancements leading to it. ramith.fyi. https://ramith.fyi/posts/2022-03-09-intro-to-optimizers/.

This is a presentation I gave at one of the Journal Club meetings in the computational imaging group at Harvard (Wadduwage Lab).

It covers how full-batch gradient descent [1] evolved into the Adam optimizer [2] as researchers addressed practical optimization challenges.

You can download the slides below. πŸ‘‡

KUDOSDon’t
Move
Thanks!