Text Classification using Spark Machine Learning

Publicado em: 15 Dezembro 2016
no canal de: Data Gurus

16,165

106

The goal of text classification is the classification of text documents into a fixed number of predefined categories. Text classification has a number of applications ranging from email spam detection to providing news feed content to users based on user preferences.
In this session, we explore how to perform text classification using Spark’s Machine Learning Library (MLlib). We see how MLlib provides a set of high-level APIs for constructing, evaluating and tuning a machine learning workflow. We explore how Spark represents a workflow as a Pipeline, which consists of a sequence of stages to be run in a specific order. The Pipeline for our text classification use case utilizes Transformer stages to prepare the raw text documents for classification, and Estimator stages to learn a machine learning model that can be used to classify documents. Finally, we illustrate how to tune the model for best fit.
Although a document classification use case is specifically explored, many of the principles demonstrated in the session can be employed in a variety of other machine learning use cases.

Here's the link to the slides
https://ibm.box.com/s/atp4ezwvo5jr27z...

And the link to the notebook as an .ipynb file.
https://ibm.box.com/s/spcj7f3uz6qetq8...

Nesta página do site você pode assistir ao vídeo on-line Text Classification using Spark Machine Learning duração hora minuto segundo em boa qualidade , que foi baixado pelo usuário Data Gurus 15 Dezembro 2016, compartilhe o link com seus amigos e conhecidos, no youtube este vídeo já foi visto 16,165 vezes e gostou 106 espectadores. Boa visualização!

266