Transformer Model: Implement EncoderDecoder
In this tutorial, we’ll complete the implementation of TransformerEncoderDecoder model. First, we’ll discuss the embeddings layers and their implementation. Next, we’ll implement TransformerEncoderDecoder class with the Generator. We’ll also try to understand why do we need to have encode, decode, and generate methods rather than just one forward method. At the end we’ll test the implementation with dummy Source and Target inputs.
In the next tutorial, we’ll train our implementation of TransformerEncoderDecoder model for Neural Machine Translation and see how well it performs. Stay tuned!!
The code used in this tutorial is available here-
https://github.com/makeesyai/makeesy-...
#pytorch #tutorial #transformer #encoder #decoder #seq2seq
En esta página del sitio puede ver el video en línea Pytorch for Beginners #43 | Transformer Model: Implement EncoderDecoder de Duración hora minuto segunda en buena calidad , que subió el usuario Makeesy AI 24 abril 2022, comparta el enlace con amigos y conocidos, en youtube este video ya ha sido visto 1,410 veces y le gustó 25 a los espectadores. Disfruta viendo!