Sequence-to-Sequence (seq2seq) Encoder-Decoder Neural Networks, Clearly Explained!!!

Published: 07 May 2023
on channel: StatQuest with Josh Starmer
348,828
6.6k

In this video, we introduce the basics of how Neural Networks translate one language, like English, to another, like Spanish. The ideas is to convert one sequence of things into another sequence of things, and thus, this type of neural network can be applied to all sort so of problems, including translating amino acids into 3-dimensional structures.

NOTE: This StatQuest assumes that you are already familiar with...
Long, Short-Term Memory (LSTM):    • Long Short-Term Memory (LSTM), Clearly Exp...  
...and...
Word Embedding:    • Word Embedding and Word2Vec, Clearly Expla...  

Also, if you'd like to go through Ben Trevett's tutorials, see: https://github.com/bentrevett/pytorch...

Finally, here's a link to the original manuscript: https://arxiv.org/abs/1409.3215

For a complete index of all the StatQuest videos, check out:
https://statquest.org/video-index/

If you'd like to support StatQuest, please consider...

Patreon:   / statquest  
...or...
YouTube Membership:    / @statquest  

...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store...
https://statquest.org/statquest-store/

...or just donating to StatQuest!
https://www.paypal.me/statquest

Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
  / joshuastarmer  

0:00 Awesome song and introduction
3:43 Building the Encoder
8:27 Building the Decoder
12:58 Training The Encoder-Decoder Model
14:40 My model vs the model from the original manuscript

#StatQuest #seq2seq #neuralnetwork


On this page of the site you can watch the video online Sequence-to-Sequence (seq2seq) Encoder-Decoder Neural Networks, Clearly Explained!!! with a duration of hours minute second in good quality, which was uploaded by the user StatQuest with Josh Starmer 07 May 2023, share the link with friends and acquaintances, this video has already been watched 348,828 times on youtube and it was liked by 6.6 thousand viewers. Enjoy your viewing!