Subword Tokenization: Byte Pair Encoding

Published: 11 November 2020
on channel: Abhishek Thakur
24,619
676

In this video, we learn how byte pair encoding works. We look at the motivation and then see how character level byte pair encoding works and we also touch byte-level BPE and wordpiece tokenization.

#BPE #BytePairEncoding #NLP

Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)

To buy my book, Approaching (Almost) Any Machine Learning problem, please visit: https://bit.ly/buyaaml

Follow me on:
Twitter:   / abhi1thakur  
LinkedIn:   / abhi1thakur  
Kaggle: https://kaggle.com/abhishek


On this page of the site you can watch the video online Subword Tokenization: Byte Pair Encoding with a duration of hours minute second in good quality, which was uploaded by the user Abhishek Thakur 11 November 2020, share the link with friends and acquaintances, this video has already been watched 24,619 times on youtube and it was liked by 676 viewers. Enjoy your viewing!