Optimizers - EXPLAINED!

Published: 10 February 2020
on channel: CodeEmporium

147,869

5.6k

From Gradient Descent to Adam. Here are some optimizers you should know. And an easy way to remember them.

SUBSCRIBE to my channel for more good stuff!

REFERENCES

[1] Have fun plotting equations : https://academo.org/demos/3d-surface-...
[2] Original paper on the Adam optimizer: https://arxiv.org/pdf/1412.6980.pdf
[3] Blog on types of optimizers: https://towardsdatascience.com/types-...
[4] Blog on optimizing gradient descent: https://ruder.io/optimizing-gradient-...
[5] Github gist of code for rending animation of a math function: https://gist.github.com/ajhalthor/335...
[6] Another Blog to quench your thirst for knowledge on optimizers cuz the other links weren't good enough: https://machinelearningmastery.com/ad...

On this page of the site you can watch the video online Optimizers - EXPLAINED! with a duration of hours minute second in good quality, which was uploaded by the user CodeEmporium 10 February 2020, share the link with friends and acquaintances, this video has already been watched 147,869 times on youtube and it was liked by 5.6 thousand viewers. Enjoy your viewing!