PATCH EMBEDDING | Vision Transformers explained

Publié le: 20 octobre 2023
sur la chaîne: ExplainingAI

12,388

337

I will cover Vision transformer in three parts. The first part which is this video focusses on patch embedding in vision transformer.
I will go over all the details and explain everything happening inside the patch embedding in VIT in detail.
I will also go over how an implementation of patch embedding for vision transformer in Pytorch would look like.

The second part which goes through attention can be found here -
Attention in Vision Transformer (Part Two) - • Multi Head Attention in Vision Transformer...
The third part which builds entire transformer and shows how to visualize attention maps and positional embeddings can be found below -
Implementing Vision Transformer (Part Three) - • Image Classification Using Vision Transfor...

Timestamps :
00:00 Intro
00:56 Need for Patch Embedding in Vision Transformer
01:30 Converting Image into Sequence of Patches
01:59 Patch Embedding Projection
02:45 Positional Information for Patches
03:40 CLS Token
04:10 Patch Embedding Responsibilities
04:40 Patch Embedding Module Implementation
08:02 Outro

Paper Link - https://tinyurl.com/exai-vit-paper
Implementation will be pushed here after all three videos are out - https://tinyurl.com/exai-vit-code
Subscribe - https://tinyurl.com/exai-channel-link

Background Track - Fruits of Life by Jimena Contreras
Email - explainingai.official@gmail.com

Sur cette page du site, vous pouvez voir la vidéo en ligne PATCH EMBEDDING | Vision Transformers explained durée heure minute seconde en bonne qualité , qui a été Téléchargé par l'utilisateur ExplainingAI 20 octobre 2023, Partagez le lien avec vos amis et connaissances, sur youtube cette vidéo a déjà été regardée 12,388 fois et il a aimé 337 téléspectateurs. Bon visionnage!

91,416

6.9K