PyTorch Hooks Explained - In-depth Tutorial

Published: 25 August 2020
on channel: Elliot Waite
35,415
1.4k

UPDATE: `register_backward_hook()` has been deprecated in favor of `register_full_backward_hook()`. You can read more about `register_full_backward_hook()` here:
https://pytorch.org/docs/stable/gener...

In this video, I explain how hooks work in PyTorch. Hooks allow you to inject code into different parts of the computational graphs (in both the forward graph and the backward graph). The four types of hooks that are available in PyTorch are:
Tensor.register_hook (https://pytorch.org/docs/stable/gener...)
Module.register_forward_pre_hook (https://pytorch.org/docs/master/gener...)
Module.register_forward_hook (https://pytorch.org/docs/master/gener...)
Module.register_backward_hook (https://pytorch.org/docs/master/gener...)

My previous video, "PyTorch Autograd Explained - In-depth Tutorial":
📼    • PyTorch Autograd Explained - In-depth...  

GitHub code examples of using hooks:
💻 https://github.com/elliotwaite/pytorc...

Join our Discord community:
💬   / discord  

Connect with me:
🐦 Twitter -   / elliotwaite  
📷 Instagram -   / elliotwaite  
👱 Facebook -   / elliotwaite  
💼 LinkedIn -   / elliotwaite  

🎵 Kazukii - Return
→   / ohthatkazuki  
→ https://open.spotify.com/artist/5d07M...
→    / officialkazuki  


On this page of the site you can watch the video online PyTorch Hooks Explained - In-depth Tutorial with a duration of hours minute second in good quality, which was uploaded by the user Elliot Waite 25 August 2020, share the link with friends and acquaintances, this video has already been watched 35,415 times on youtube and it was liked by 1.4 thousand viewers. Enjoy your viewing!