BERT Document Classification Tutorial with Code

Published: 14 January 2020
on channel: InnerWorkingsAI

71,302

1.1k

==== Free Course & Notebook ====
The notebook and a video course version of this tutorial are available for FREE on my website, here: https://www.chrismccormick.ai/offers/...

Learn how to fine-tune BERT for document classification. We'll be using the Wikipedia Personal Attacks benchmark as our example.

Bonus - In Part 3, we'll also look briefly at how we can apply BERT to search for "semantically similar" comments in the dataset.

==== Pre-reqs ====
This tutorial builds on my “BERT Fine-Tuning Tutorial with PyTorch”. If you want to know more of the basics of fine-tuning BERT, check it out!
Video: • BERT Research - Ep. 3 - Fine Tuning - p.1
Free Notebook: https://colab.research.google.com/dri...

==== References ====
Here are the links for the dataset (these are also provided in my notebook):
wikimedia page describing the dataset: https://figshare.com/articles/Wikiped...
Dataset download page on figshare.com for the personal attack comments: https://figshare.com/articles/Wikiped...
Example notebook (from the authors) for getting started with the dataset: https://github.com/ewulczyn/wiki-deto...

==== Updates ====
Sign up to hear about new content across my blog and channel! https://www.chrismccormick.ai/subscribe

On this page of the site you can watch the video online BERT Document Classification Tutorial with Code with a duration of hours minute second in good quality, which was uploaded by the user InnerWorkingsAI 14 January 2020, share the link with friends and acquaintances, this video has already been watched 71,302 times on youtube and it was liked by 1.1 thousand viewers. Enjoy your viewing!

13,912

323