Text Classification using Spark Machine Learning

Опубликовано: 15 Декабрь 2016
на канале: Data Gurus

16,165

106

The goal of text classification is the classification of text documents into a fixed number of predefined categories. Text classification has a number of applications ranging from email spam detection to providing news feed content to users based on user preferences.
In this session, we explore how to perform text classification using Spark’s Machine Learning Library (MLlib). We see how MLlib provides a set of high-level APIs for constructing, evaluating and tuning a machine learning workflow. We explore how Spark represents a workflow as a Pipeline, which consists of a sequence of stages to be run in a specific order. The Pipeline for our text classification use case utilizes Transformer stages to prepare the raw text documents for classification, and Estimator stages to learn a machine learning model that can be used to classify documents. Finally, we illustrate how to tune the model for best fit.
Although a document classification use case is specifically explored, many of the principles demonstrated in the session can be employed in a variety of other machine learning use cases.

Here's the link to the slides
https://ibm.box.com/s/atp4ezwvo5jr27z...

And the link to the notebook as an .ipynb file.
https://ibm.box.com/s/spcj7f3uz6qetq8...

На этой странице сайта вы можете посмотреть видео онлайн Text Classification using Spark Machine Learning длительностью часов минут секунд в хорошем качестве, которое загрузил пользователь Data Gurus 15 Декабрь 2016, поделитесь ссылкой с друзьями и знакомыми, на youtube это видео уже посмотрели 16,165 раз и оно понравилось 106 зрителям. Приятного просмотра!

73,410

1.8 тыс