BERT Explained!

Published: 06 February 2020
on channel: Connor Shorten
88,974
945

This video explains the BERT Transformer model! BERT restructures the self-supervised language modeling task on massive datasets like Wikipedia. Bi-directional prediction describes masking intermediate tokens and using tokens on the left and right of the mask for predicting what was masked. This video also explores the input and output representations and how this facilitates fine-tuning the BERT transformer!

Links Mentioned in Video:
The Illustrated Transformer: http://jalammar.github.io/illustrated...
Tokenizers: How Machines Read: https://blog.floydhub.com/tokenizatio...
SQuAD: https://rajpurkar.github.io/SQuAD-exp...
BERT: https://arxiv.org/abs/1810.04805

Thanks for watching! Please Subscribe!


On this page of the site you can watch the video online BERT Explained! with a duration of hours minute second in good quality, which was uploaded by the user Connor Shorten 06 February 2020, share the link with friends and acquaintances, this video has already been watched 88,974 times on youtube and it was liked by 945 viewers. Enjoy your viewing!