The Most Important Algorithm in Machine Learning

Published: 31 March 2024
on channel: Artem Kirsanov
440,409
20k

Shortform link:
https://shortform.com/artem

In this video we will talk about backpropagation – an algorithm powering the entire field of machine learning and try to derive it from first principles.

OUTLINE:
00:00 Introduction
01:28 Historical background
02:50 Curve Fitting problem
06:26 Random vs guided adjustments
09:43 Derivatives
14:34 Gradient Descent
16:23 Higher dimensions
21:36 Chain Rule Intuition
27:01 Computational Graph and Autodiff
36:24 Summary
38:16 Shortform
39:20 Outro

USEFUL RESOURCES:
Andrej Karpathy's playlist:    • Neural Networks: Zero to Hero  

Jürgen Schmidhuber's blog on the history of backprop:
https://people.idsia.ch/~juergen/who-...


CREDITS:
Icons by https://www.freepik.com/


On this page of the site you can watch the video online The Most Important Algorithm in Machine Learning with a duration of hours minute second in good quality, which was uploaded by the user Artem Kirsanov 31 March 2024, share the link with friends and acquaintances, this video has already been watched 440,409 times on youtube and it was liked by 20 thousand viewers. Enjoy your viewing!