Data Cleaning and Preprocessing using Python | Machine Learning and Data Science |
In this video we are using python library "samoy" for data cleaning.It is built on pandas but better in terms of efficiency and user level customization.
I have used data set from kaggle.
Lets understand samoy in brief:
Auto Data cleaner - "samoy"
samoy is a Python package for machine learning and data science, built on top of Pandas inbuilt libraries. This package will be useful for data pre-processing before starting off any machine learning or data science project as it will ease your entire process of data cleaning without much input from the user.
*User installation
If you already have a working installation of numpy and pandas, the easiest way to install samoy is using pip:
pip install samoy
---------------------------------
*Package Utilities
In current version of this package it only handles missing,null values and duplicates along with case conversion
Utilities supported:
1. Null values handling : Dropping and imputing(with mean,median as well as custom values)
2. Imputing null values with the threshold as mentioned by the user in terms of percentage
3. Missing values handling : Dropping and imputing(with mean,median and LRU)
4. Duplicates removal
5. Case conversion like if use wants to convert specific columns or entire column values into either lower or upper case
Samoy in Pypi : https://pypi.org/project/samoy/
Data Science Concepts:
• Complete Data Science Series | Statis...
Statistics Part 1 : • Statistics : How Statistics is Useful...
Statistics Part 2 : • Mean, Median, Percentile | Statistics...
Statistics Part 3 : • Statistical Distribution | Statistics...
Statistics Part 4 : • Hypothesis Testing | Statistics For D...
Please subscribe to the channel for amazing technological videos and comment on your doubts and requirement below.
Credit : Priyanka Singh (Gold Medalist in Computer Engineering SPPU Pune, M-Tech College of Engineering Pune, Ex Data Scientist From Reliance Industries Limited Mumbai.)
Priyanka Singh Linkedin :
/ priyanka-singh-350082116
Research Work in IEEE:
https://ieeexplore.ieee.org/document/...
Follow us on
Twitter : https://twitter.com/Forerun27232724?s=09
Facebook : / forerunners-110750477376350
Instagram : https://www.instagram.com/invites/con...
#DataScience #MachineLearning #Python
Nesta página do site você pode assistir ao vídeo on-line Data Cleaning and Preprocessing using Python | Machine Learning and Data Science | duração hora minuto segundo em boa qualidade , que foi baixado pelo usuário Forerunners 20 Agosto 2020, compartilhe o link com seus amigos e conhecidos, no youtube este vídeo já foi visto 7,996 vezes e gostou 97 espectadores. Boa visualização!
