Deep Learning DIY by Marc Lelarge / marc_lelarge
slides: https://dataflowr.github.io/website/m...
0:00 Recap
0:31 Plan
1:14 Optimization in deep learning
3:44 Gradient descent variants
7:58 Setting for the jupyter notebook
9:49 Vanilla gradient descent
12:14 Momentum
15:38 Nesterov accelerated gradient descent
18:00 Adagrad
20:06 RMSProp
22:11 Adam
24:39 AMSGrad
27:09 Pytorch optimizers
full course: https://www.dataflowr.com/
On this page of the site you can watch the video online Pytorch tutorial: Optimization for deep leaning with a duration of hours minute second in good quality, which was uploaded by the user Dataflowr 21 April 2020, share the link with friends and acquaintances, this video has already been watched 1,412 times on youtube and it was liked by 16 viewers. Enjoy your viewing!