PATCH EMBEDDING | Vision Transformers explained

Опубликовано: 20 Октябрь 2023
на канале: ExplainingAI

12,388

337

I will cover Vision transformer in three parts. The first part which is this video focusses on patch embedding in vision transformer.
I will go over all the details and explain everything happening inside the patch embedding in VIT in detail.
I will also go over how an implementation of patch embedding for vision transformer in Pytorch would look like.

The second part which goes through attention can be found here -
Attention in Vision Transformer (Part Two) - • Multi Head Attention in Vision Transformer...
The third part which builds entire transformer and shows how to visualize attention maps and positional embeddings can be found below -
Implementing Vision Transformer (Part Three) - • Image Classification Using Vision Transfor...

Timestamps :
00:00 Intro
00:56 Need for Patch Embedding in Vision Transformer
01:30 Converting Image into Sequence of Patches
01:59 Patch Embedding Projection
02:45 Positional Information for Patches
03:40 CLS Token
04:10 Patch Embedding Responsibilities
04:40 Patch Embedding Module Implementation
08:02 Outro

Paper Link - https://tinyurl.com/exai-vit-paper
Implementation will be pushed here after all three videos are out - https://tinyurl.com/exai-vit-code
Subscribe - https://tinyurl.com/exai-channel-link

Background Track - Fruits of Life by Jimena Contreras
Email - explainingai.official@gmail.com

На этой странице сайта вы можете посмотреть видео онлайн PATCH EMBEDDING | Vision Transformers explained длительностью часов минут секунд в хорошем качестве, которое загрузил пользователь ExplainingAI 20 Октябрь 2023, поделитесь ссылкой с друзьями и знакомыми, на youtube это видео уже посмотрели 12,388 раз и оно понравилось 337 зрителям. Приятного просмотра!

91,416

6.9 тыс