Tutorial: Text Classification using GPT2 and Pytorch

Published: 09 April 2021
on channel: AICamp
9,116
140

Text classification is a very common problem that needs solving when dealing with text data. We’ve all seen and know how to use Encoder Transformer models like Bert and RoBerta for text classification but did you know you can use a Decoder Transformer model like GPT2 for text classification?
In this tutorial, I will walk you through on how to use GPT2 from HuggingFace for text classification. We will start with downloading customized dataset, installing required componments, selecting pre-trained models, and then train the model. we will finally evaluate the results and how to optimize further.

Speaker: George Mihaila
Resources:
website: https://www.aicamp.ai/event/eventdeta...
slides: https://gmihaila.github.io/presentati...
colabs: https://colab.research.google.com/git...


On this page of the site you can watch the video online Tutorial: Text Classification using GPT2 and Pytorch with a duration of hours minute second in good quality, which was uploaded by the user AICamp 09 April 2021, share the link with friends and acquaintances, this video has already been watched 9,116 times on youtube and it was liked by 140 viewers. Enjoy your viewing!